| /rocksdb-6.9/java/src/test/java/org/rocksdb/ |
| D | BackupEngineTest.java | 44 be.createNewBackup(db, false); in backupDb()
45 be.createNewBackup(db, true); in backupDb()
63 be.createNewBackup(db, false); in deleteBackup()
64 be.createNewBackup(db, true); in deleteBackup()
91 be.createNewBackup(db, false); in purgeOldBackups()
92 be.createNewBackup(db, true); in purgeOldBackups()
93 be.createNewBackup(db, true); in purgeOldBackups()
94 be.createNewBackup(db, true); in purgeOldBackups()
98 be.purgeOldBackups(1); in purgeOldBackups()
122 be.createNewBackup(db, true); in restoreLatestBackup()
[all …]
|
| /rocksdb-6.9/docs/_posts/ |
| D | 2015-07-23-dynamic-level.markdown | 17 …be 1GB, and size multiplier to be 10, and the target size of level 1, 2, 3, 4 will be 1GB, 10GB, 1…
23 …be equal as the size of last level before the compaction. On the other hand, the size of user data…
26 …be approximately (1000GB + 100GB + 10GB + 1GB) / 1000GB = 1.111, which is a very good number. Howe…
29 …be 10, and the DB size is 200GB. The target size of the last level is automatically set to be the …
|
| D | 2015-11-10-use-checkpoints-for-efficient-snapshots.markdown | 10 …be used as a point in time snapshot, which can be opened Read-only to query rows as of the point i…
15 …be hard-linked, otherwise SST files will be copied. The manifest and CURRENT files will be copied.…
20 A Checkpoint object needs to be created for a database before checkpoints are created. The API is a…
40 …be created by this API. The directory will be an absolute path. The checkpoint can be used as a r…
|
| D | 2014-03-27-how-to-backup-rocksdb.markdown | 28 …tmp/rocksdb_backup". Creating new BackupableDB consumes DB* and you should be calling all the DB m…
73 …be copied to backup directory (for more details on what gets copied, see "Under the hood"). Checks…
75 …many backups you'd like to keep. All backups except the N newest ones will be deleted. You can als…
84 …ill be used for all file I/O related to backup dir (writes when backuping, reads when restoring). …
88 …be consistent after a reboot or if machine crashes. Setting it to false will speed things up a bit…
92 …p will also include log files corresponding to live memtables. Backup will be consistent with curr…
115 …owever, checksum is calculated for all files regardless if a file needs to be copied or not. If a …
128 …EST_BACKUP` and clean up all the files since some of the table files might be corrupted. Having co…
|
| D | 2018-11-21-delete-range.markdown | 27 product is removed, all these keys must be deleted.
37 through the to-be-deleted range, and issue a `Delete` for each key. This is
38 slow (involves read I/O) so cannot be done in any critical path. Additionally,
43 the deleted range(s). This deletes the range asynchronously, so cannot be used
55 `DeleteFilesInRange` can be used prior to compacting the deleted range as long
59 reaches the bottom of the LSM, where tombstones can finally be dropped.
63 of keys would be (1) simple, i.e., a single API call; (2) synchronous, i.e.,
65 latency so it can be used in critical paths; and (4) a first-class operation
74 tombstone covering a key could be anywhere, making binary search impossible.
93 tombstones to be aware of flush/compaction. An easy way to achieve this is put
[all …]
|
| D | 2016-04-26-rocksdb-4-5-1-released.markdown | 23 …* Statistics of mutex operation durations will not be measured by default. If you want to have the…
29 … in include/rocksdb/sst_file_manager.h to create a SstFileManager that can be used to track the to…
41 …* If options.max_write_buffer_number > 3, writes will be slowed down when writing to the last writ…
45 … the name of either MANIFEST, SST or a WAL file. Either --db or --path can be used when calling ld…
53 …ew member function called IgnoreSnapshots which allows CompactionFilter to be called even if there…
60 … triggers, only the column family with the largest column family size will be flushed, not all the…
|
| D | 2017-01-06-rocksdb-5-0-1-released.markdown | 15 …ed among RocksDB instance. Alternatively DB::GetLatestSequenceNumber() can be used to get the same…
23 …hing unpersisted data (i.e. with disableWAL = true). Unpersisted data will be lost. The options is…
24 … is mean to reduce CPU usage for inserting keys into memtable, if keys can be group by prefix and …
25 …o write compaction filters in Lua. To use this feature, LUA_PATH needs to be set to the root dire…
26 … formerly contained the number of the latest backup. The latest backup can be determined by findin…
|
| D | 2014-05-14-lock.markdown | 25 This DB mutex used to be scalability bottleneck preventing us from scaling to more than 16 threads.…
31 …s, so that decreasing reference count of an object usually doesn’t need to be inside the mutex any…
35 …s we know, each disk I/O to hard drives takes several milliseconds. It can be even longer if file …
41 … be slow because it involves malloc (in our case). Malloc sometimes is slow because it needs to lo…
43 …ctor class. When an autovector is used as a stack variable, no malloc will be needed unless the pr…
45 …rging iterator on top of them. Besides malloc, some of those iterators can be quite expensive to c…
49 …be evicted based on LRU, those information is cleared. When the SST table needs to be read and its…
63 …ot found an option that allows sharing the rocksdb for reads. An example would be most appreciated.
75 …Please remember to delete the directory after reading the data to allow those files to be recycled.
|
| D | 2018-08-23-data-block-hash-index.markdown | 9 …t this feature. After turned on the hash index feature, existing data will be gradually converted …
21 // the definitions can be found in include/rocksdb/table.h
23 // The index type that will be used for the data block.
66 …be regarded as equal. However, some specially crafted comparators will do. For example, say, a `St…
75 …the function returns true, and as a result the hash index feature will not be enabled, and vice ve…
77 …ysWithDifferentByteContentsBeEqual()` function to return `false`, so the hash index can be enabled.
87 …be more than 253 (we reserved 255 and 254 as special flags). For blocks having a larger number of…
115 …8GB, hash index can bring throughput gain. Cache size greater than 8GB can be translated to a cach…
|
| D | 2017-06-26-17-level-based-changes.markdown | 10 … (unlike files at lower levels) can span the entire key-range, a key might be in any file, thus re…
12 Although, the mechanism with which we enforce L0's file count limit may be unappealing. When the li…
14 …re key-range, compaction parallelization is limited. Files at L0 or L1 may be locked due to involv…
16 …ew type of compaction, L0->L0. It quickly reduces file count in L0 and can be scheduled even when …
20 …that files can overlap in the input level, so those overlapping files must be pulled in as well. F…
30 … to overlap. Notice this leaves the database in a state where we might not be able to schedule par…
48 …r files as long as they're not being compacted. Since the largest file may be anywhere, the old L0…
54 Now, there can never be L0 files unreachable for L0->L0 due to L0->L1 selecting files in the middle…
56 This feature will be available in RocksDB 5.7.
|
| D | 2017-05-12-partitioned-index-filter.markdown | 8 …the performance by i) occupying the block cache space that could otherwise be used for caching dat…
12 … compete with data blocks for the block cache space and are also likely to be re-read many times f…
16 …resource. A filter of size 5MB is occupying the space that could otherwise be used to cache 1000s …
18 After the cache miss of an index/filter, it has to be reloaded from the disk, and its large size is…
22 …r query. The top-level index, which has much smaller memory footprint, can be stored in heap or bl…
32 In this example we have a DB of size 300G on SSD and emulate the small memory that would be availab…
|
| D | 2016-07-26-rocksdb-4-8-released.markdown | 15 …toreBackupableDB). Now, BackupEngine should be used for creating backups, and BackupEngineReadOnly…
17 …* Added EventListener::OnTableFileCreationStarted. EventListener::OnTableFileCreated will be calle…
40 …tions.format_version to 2. It means default DB created by 4.6 or up cannot be opened by RocksDB ve…
41 …e flag is set to true, insert to cache will fail if no enough capacity can be free. Signature of C…
|
| D | 2017-05-26-rocksdb-5-4-5-released.markdown | 17 * Memtable flush can be avoided during checkpoint creation if total log file size is smaller than a…
19 …e feature can be enabled by setting partition_filters when using kFullFilter. Currently the featur…
37 * Fix snprintf's usage to be cross-platform.
|
| D | 2015-10-27-getthreadlist.markdown | 10 …the RocksDB background thread activity. With this feature, developers will be able to obtain the r…
130 // be tracked and available via GetThreadList() API.
148 Since an Env can be shared across multiple rocksdb instances, the output of
160 // The type of the thread, it could be HIGH_PRIORITY,
165 // involved with. It would be set to empty string if the thread
170 // It would be set to empty string if the thread does not involve
|
| D | 2015-02-24-reading-rocksdb-options-from-a-file.markdown | 10 …be provided using a file or any string to RocksDB. The format is straightforward: `write_buffer_si…
|
| D | 2017-12-19-write-prepared-txn.markdown | 12 …es the read path as any data that is read by other transactions can be assumed to be committed. Th…
16 …ll readers. To make the commit phase lightweight, the memtable write could be done at either `::Pr…
20 These are the primary design questions that needs to be addressed:
25 …ites a commit marker to the WAL, whose sequence number, `commit_seq`, will be used as the commit t…
27 …caches the recent commit entries. Looking up the entries in the cache must be enough for almost al…
|
| D | 2017-12-18-17-auto-tuned-rate-limiter.markdown | 12 …be enabled simply by passing `auto_tuned=true` in the `NewGenericRateLimiter()` call. In this case…
16 …ower-bound that we derive internally. Users can expect this lower bound to be 1-2 orders of magnit…
|
| /rocksdb-6.9/ |
| D | HISTORY.md | 59 * Fix a bug that can cause unnecessary bg thread to be scheduled(#6104).
320 * Add a place holder in manifest which indicate a record from future that can be safely ignored.
383 …be called for empty files generated during compaction. In that case, `TableFileCreationInfo::file_…
565 * `DBOptions::writable_file_max_buffer_size` can now be changed dynamically.
866 …to the Comparator interface that can optionally be overwritten in cases where equality comparisons…
936 Lower numbered levels will be placed earlier in the db_paths and higher
937 numbered levels will be placed later in the db_paths vector.
973 implementation of the API LinkFile will have to be provided.
977 * RocksDBLite library now becomes smaller and will be compiled with -fno-exceptions flag.
1007 * Add identity_as_first_hash property to CuckooTable. SST file needs to be rebuilt to be opened by …
[all …]
|
| D | CODE_OF_CONDUCT.md | 31 * Other conduct which could reasonably be considered inappropriate in a
53 a project may be further defined and clarified by project maintainers.
57 Instances of abusive, harassing, or otherwise unacceptable behavior may be
59 complaints will be reviewed and investigated and will result in a response that
62 Further details of specific enforcement policies may be posted separately.
|
| D | COPYING | 54 patent must be licensed for everyone's free use or not licensed at all.
63 a notice placed by the copyright holder saying it may be distributed
100 part thereof, to be licensed as a whole at no charge to all third
116 and can be reasonably considered independent and separate works in
120 on the Program, the distribution of the whole must be on the terms of
139 source code, which must be distributed under the terms of Sections
145 machine-readable copy of the corresponding source code, to be
207 the only way you could satisfy both it and this License would be to
227 be a consequence of the rest of this License.
301 This program is distributed in the hope that it will be useful,
[all …]
|
| /rocksdb-6.9/examples/ |
| D | c_simple_example.c | 20 rocksdb_backup_engine_t *be; in main() local
36 be = rocksdb_backup_engine_open(options, DBBackupPath, &err); in main()
56 rocksdb_backup_engine_create_new_backup(be, db, &err); in main()
63 rocksdb_backup_engine_restore_db_from_latest_backup(be, DBPath, DBPath, in main()
75 rocksdb_backup_engine_close(be); in main()
|
| /rocksdb-6.9/docs/ |
| D | _config.yml | 10 # organisation.github.io/reponame/ basic site URL, then baseurl would be set
17 # If baseurl is set, then the absolute url for your site would be url/baseurl
18 # This was also be set to the right thing automatically for local development
36 # primary should be a vivid color that reflects the project's brand
38 # secondary should be a subtle light or dark color used on page backgrounds
41 # or 'dark' and therefore what colors can be overlaid on them
52 # and `top-level`. This means their content will be in `_docs` and `_top-level`.
|
| D | LICENSE-DOCUMENTATION | 46 the licensed material may still be restricted for other
49 such as asking that all changes be marked or described.
60 to be bound by the terms and conditions of this Creative Commons
62 extent this Public License may be interpreted as a contract, You are
93 absence of proper authority, may not be circumvented under laws
181 may be construed as permission to assert or imply that You
303 above shall be interpreted in a manner that, to the extent
349 be made without permission under this Public License.
354 cannot be reformed, it shall be severed from this Public License
371 licenses to material it publishes and in those instances will be
[all …]
|
| /rocksdb-6.9/docs/_docs/ |
| D | faq.md | 12 RocksDB is an embeddable persistent key-value store for fast storage. RocksDB can also be the found…
14 … be scalable to run on servers with many CPU cores, to efficiently use fast storage, to support IO…
22 …aw frequent write-stalls with LevelDB that caused 99-percentile latency to be tremendously large. …
26 RocksDB can be used by applications that need low latency database accesses. Possibilities include:
36 …yDB are in [Muthu Annamalai’s talk at Data@Scale in Seattle](https://youtu.be/DfiN7pG0D0k). Dragon…
38 RocksDB is proving to be a useful component for a lot of other groups in the industry. For a list o…
48 …t on [GitHub](http://github.com/facebook/rocksdb) because we think it will be useful beyond Facebo…
|
| /rocksdb-6.9/tools/rdb/ |
| D | API.md | 18 # column families, this argument can be
30 # This argument can be left off for the default
44 # in. This argument can be left off for the
57 # This argument can be left off for the default
73 # This argument can be left off for the default
139 the key 'string1' should be associated with the value 'string2'
140 * 'delete' => Array of strings, each of which is a key whose value should be
|