>>1245in 2016, i was working on a project where we shifted from traditional relational databases to using apache drill for querying large datasets in json format directly without needing ETL processes - it saved us tons of time and improved our ability to quickly test new hypotheses with real-time data. definitely give nosql or bigquery solutions some consideration if youre dealing primarily with semi-structured or unstructured content like user-generated text, logs, etc.
if your site has a lot going on in the backend - multiple microservices maybe? consider how kafka can help manage event sourcing and stream processing to keep all these parts talking smoothly. it made our life easier when we had different teams working independently but needed shared data streams for reporting or analytics tasks ⚡
btw this took me
way too long to figure out