TxFS Linux File-System Supports ACID Transactions, Simple API - Phoronix
Show Your Support: This site is primarily supported by advertisements. Ads are what have allowed this site to be maintained on a daily basis for the past 19+ years. We do our best to ensure only clean, relevant ads are shown, when any nasty ads are detected, we work to remove them ASAP. If you would like to view the site without ads while still supporting our work, please consider our ad-free Phor
Sequential File Prefetching In Linux
Earning a degree from the Department of Electrical and Computer Engineering at Wayne State University gives you the tools needed to create a faster smartphone, a thinner laptop or a more powerful automotive navigation system. Electrical and computer engineers design and build the gadgets people use every day, as well as the computer hardware within larger systems such as airplanes and robotic asse
Google Sites: Sign-in
Not your computer? Use a private browsing window to sign in. Learn more about using Guest mode
IPFS is the Distributed Web
Discover What's Out There with IPFS IPFS is an open system to manage data without a central server A Universe of Uses IPFS's versatility shines across different industries – making it the multi-purpose tool for the decentralized age. Develop offline-native productivity toolsAnytype uses the content addressing on IPFS to empower users to build personal knowledge webs that can be shared with others
Replication-Friendly Redis-based filesystem
redisfs - A replication-friendly filesystem. Redis is an in-memory key & value store, which is simple to install, configure & use. It is particularly useful because it is very simple to use in a replicated fashion. The notion of a replication-friendly storage system inspired me to build a filesystem around it, using the FUSE system. Using a key & value storage system to store files might not seem
NOVA: A Log-structured File System for Hybrid Volatile/Non-volatile Main Memories | USENIX
NOVA: A Log-structured File System for Hybrid Volatile/Non-volatile Main Memories Fast non-volatile memories (NVMs) will soon appear on the processor memory bus alongside DRAM. The resulting hybrid memory systems will provide software with sub-microsecond, high-bandwidth access to persistent data, but managing, accessing, and maintaining consistency for data stored in NVM raises a host of challeng
Don't defer Close() on writable files
Update: Another approach suggested by the inimitable Ben Johnson has been added to the end of the post. Update 2: Discussion about fsync() added to the end of the post. It’s an idiom that quickly becomes rote to Go programmers: whenever you conjure up a value that implements the io.Closer interface, after checking for errors you immediately defer its Close() method. You see this most often when ma
35% Faster Than The Filesystem
1. Summary SQLite reads and writes small blobs (for example, thumbnail images) 35% faster¹ than the same blobs can be read from or written to individual files on disk using fread() or fwrite(). Furthermore, a single SQLite database holding 10-kilobyte blobs uses about 20% less disk space than storing the blobs in individual files. The performance difference arises (we believe) because when working
第2回 大量トラフィックを支えるインフラ～独自プロトコル、ファイルシステムの実装もいとわない！～ | gihyo.jp
ドワンゴのエンジニア魂 第2回大量トラフィックを支えるインフラ～独自プロトコル、ファイルシステムの実装もいとわない！～ 大量のユーザーを抱える「ニコニコ動画（ニコ動）」「ニコニコ生放送（ニコ生）」をさらに進化させるべく、ドワンゴでは土台となる基盤を見直し、大幅なアップデートを実施した。ドワンゴのエンジニアである原耕司氏（写真1）、太田健氏（写真2）、川平航介氏（写真3）の3名にお話を伺い、プロトコルや分散ファイルシステムまで独自に開発したという、このプロジェクトの真相に迫った。 将来のサービス拡充に向けて土台を整備 ――今回、サービスの基盤部分を大幅に刷新された理由は何でしょうか。 原：ニコ動は、サービスの提供開始から時間が経ったことで裏側のコードが複雑になっており、これから新たな機能をバンバン追加するのが厳しい状況になっていました。そこで、将来的なサービス拡充に対応で
SGI - The Trusted Leader in Technical Computing: HPC, Servers, Storage, Data Center Solutions, Cl...
libeatmydata - disable fsync and SAVE!
libeatmydata is a small LD_PRELOAD library designed to (transparently) disable fsync (and friends, like open(O_SYNC)). This has two side-effects: making software that writes data safely to disk a lot quicker and making this software no longer crash safe. DO NOT use libeatmydata on software where you care about what it stores. It's called libEAT-MY-DATA for a reason. Source I've recently been migra
2016年5月18日 USB 3.1対応、新ファイルシステム「OrangeFS」など新機能満載のLinux 4.6がリリース | gihyo.jp
Linux Daily Topics 2016年5月18日USB 3.1対応、新ファイルシステム「OrangeFS」など新機能満載のLinux 4.6がリリース Linus Torvaldsは5月15日（米国時間）、Linux 4.6を正式公開した。7本のリリース候補版（rc）を出した後の「通常のスケジュールで」（Linus）リリースされた4.6だが、久々に大きな機能追加がいくつも行われたカーネルとなっている。 Linux 4.6で新たに追加／強化された主な機能は以下のとおり。 10GbpsのUSB 3.1 SuperSpeedPlus OOM（Out of Memory）タスクキラーの信頼性向上 Intelの新CPUに対応したメモリプロテクションキー 分散ファイルシステム「OrangeFS」 TCPを使ったメッセージの送受信を効率化するKCM（Kernel Connection M
Linuxファイルシステム技術解説
XFSは、巨大ストレージでの利用を視野に入れた64bitファイルシステムである。膨大な領域を効率的に利用するため、XFSにはさまざまな仕組みが組み込まれている。（編集局）
_Details)
Linux Multi-Queue Block IO Queueing Mechanism (blk-mq) Details - Thomas-Krenn-Wiki-en
Blk-mq integrates seamlessly into the Linux storage stack. It provides basic functions to device drivers for mapping I/O enquiries to multiple queues. The tasks are distributed across multiple threads and therefore to multiple CPU cores (per-core software queues). Blk-mq compatible drivers inform blk-mq how many parallel hardware queues a device supports (number of submission queues as part of the
Introduction | Apple File System Guide
Apple File System is a new, modern file system for iOS, macOS, tvOS, and watchOS. It is optimized for Flash/SSD storage and features strong encryption, copy-on-write metadata, space sharing, cloning for files and directories, snapshots, fast directory sizing, atomic safe-save primitives, and improved file system fundamentals. APFS replaces HFS+ as the default file system for iOS 10.3 and later, an
shiftfs: uid/gid shifting filesystem [LWN.net]
This is currently an RFC because the patch applies to Linus head, but needs altering for the vfs tree, so I'll respin and resend after the merge window closes. My use case for this is that I run a lot of unprivileged architectural emulation containers on my system using user namespaces. Details here: http://blog.hansenpartnership.com/unprivileged-build-cont... They're mostly for building non-x86 s
Non-blocking Writes to Files | USENIX
Daniel Campello and Hector Lopez, Florida International University; Luis Useche, Google Inc.; Ricardo Koller, IBM T. J. Watson Research Center; Raju Rangaswami, Florida International University Writing data to a page not present in the file-system page cache causes the operating system to synchronously fetch the page into memory first. Synchronous page fetch defines both policy (when) and mechanis
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
Apache Hadoop Distribution | MapR
Software Design 2017年2月号にファイルシステムの特集記事を書きました - Gentoo metalog
Linux-Kernel Archive: [GIT PULL] ext4 changes for 4.6