aboutsummaryrefslogtreecommitdiff
path: root/README.md
diff options
context:
space:
mode:
authorFurkan Sahin <furkan-dev@proton.me>2022-10-31 17:32:08 -0500
committerFurkan Sahin <furkan-dev@proton.me>2022-10-31 17:32:08 -0500
commit19daf7966a3b6a6dd4dea451d210fd0a40b1279b (patch)
tree8a8e4adf1a9427498f09d717ed94adea3ae0c661 /README.md
parent14e0fc4374ebcd3378421f090362b0d51397e0ae (diff)
Update readmeHEADmain
Diffstat (limited to 'README.md')
-rw-r--r--README.md10
1 files changed, 7 insertions, 3 deletions
diff --git a/README.md b/README.md
index c789e09..7d9b441 100644
--- a/README.md
+++ b/README.md
@@ -15,8 +15,12 @@ which is impractical for most human genome data.
Notes:
+- Currently, `qidx` is very inefficient in terms of disk space. When indexing a 33GiB BAM file
+ (Illumina 35x), it takes up 22GiB on disk when using STD compression. It initially maps 1.2TiB
+ into memory. This is reduced to ~120GiB due to file holes. ZSTD block compression again reduces
+ this to 22GiB. When I get a chance, I hope to look into this further.
- `qidx` creates a disk-backed hashset using a sparse memory-mapped file. The underlying
-operating system must support `mmap` and file holes
+operating system must support `mmap` and file holes.
- `qidx` doesn't currently support compression. it is currently recommended to
-use block-level compression (such as `zfs` `zstd` compression)
-- the bamfile must be sorted by query name before the index is built `samtools sort -n`
+use block-level compression (such as `zfs` `zstd` compression.)
+- The bamfile must be sorted by query name before the index is built `samtools sort -n`.