#dataengineering

Indexing the Data Lake for Online Point Queries https://engineering.atspotify.com/2026/7/indexing-the-data-lake-for-online-point-queries/ #DataEngineering #BigData #CloudComputing

A Fast Path for Fixed-Length Lists in Parquet https://www.morling.dev/blog/fast-path-for-fixed-length-lists-in-parquet/ #DataEngineering #Performance #Parquet

🛠️ pracdata/awesome-open-source-data-engineering A curated list of open source tools used in analytics platforms and data engineering ecosystem Compiles software tools across storage, streaming, integration, and metadata management for data architecture platforms. ⭐ Stars: 592 📅 Last Update: Jul 24, 2026 https://github.com/pracdata/awesome-open-source-data-engineering #selfhosted #homelab #selfhost #selfhosting #opensource #dataengineering #databases

Building an in-house scraper? Before investing months in development, compare the real costs with a managed data solution. Learn about: 📊 Cost ⚡ Scalability 🛠 Maintenance 🔒 Reliability 📈 ROI Read here 👇 https://www.foodspark.io/foodspark-vs-in-house-data-scraping/ #WebScraping #FoodData #DataEngineering

We've launched a GitHub Sponsors page for Psycopg 🐘🐍 Psycopg has been the standard PostgreSQL adapter for Python for 20 years. Your sponsorship goes directly towards maintaining Psycopg 2 and Psycopg 3, and keeping the project active and up to date. Sponsors are also listed on our new sponsors page on the Psycopg website. Links in replies 👇 #PostgreSQL #Python #Psycopg #OpenSource #FOSS #DataEngineering