[ Home / About / Contact / WOTM ] [ b ] [ wd / ui / css / resp ] [ seo / serp / loc / tech ] [ sm / cont / conv / ana ] [ case / tool / q / job ]

/tech/ - Technical SEO

Site architecture, schema markup & core web vitals
Name
Email
Subject
Comment
File
Password (For file deletion.)

File: 1792838006733.jpg (103.27 KB, 1024x1024, img_1792837986750_4i6zt4rg.jpg)ImgOps Exif Google Yandex

5103b No.2380

Using byte range requests to pull parts of compressed VCF files directly from S3 sounds pretty efficient for avoiding massive transfers. I wonder if bcftools can handle the overhead once you scale up the number of concurrent Lambda functions hitting the same objects.

article: https://www.infoq.com/news/2026/10/csiro-serverless-genomic-variant/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=global

5103b No.2394

>>2380
I ran into this with a genomics pipeline last year and the bottleneck ended up being S3 throttles rather than bcftools itself once we started spinning up too many concurrent workers.


[Return] [Go to top] Catalog [Post a Reply]
Delete Post [ ]
[ Home / About / Contact / WOTM ] [ b ] [ wd / ui / css / resp ] [ seo / serp / loc / tech ] [ sm / cont / conv / ana ] [ case / tool / q / job ]