How Statsig Engineers are Doing Observability Right
The Data Engineering Show
by The Firebolt Data Bros
2M ago
80% of the code that you write doesn’t work on the first try. And that’s fine. But knowing which 80% is not working and which 20% is working is the actual challenge. After 10 years at Facebook, managing and scaling the Seattle site to over 6000 engineers(!) Vijaye Raji founded Statsig to make observability automated and real-time. How is the semantic layer managed? How was the Statsig team able to build an observability product that handles real-time ever-changing metadata? What are Vijaye’s main takeaways from engineering at Facebook? Tune in ..read more
Visit website
A ClickHouse Review from a Practitioner’s Point of View
The Data Engineering Show
by The Firebolt Data Bros
5M ago
Sudeep Kumar, Principal Engineer at Salesforce is a ClickHouse fan. He considers the shift to Clickhouse as one of his biggest accomplishments during his eBay days and walks Boaz through his experience with the platform. How on one hand it handled 2B events per minute, but also how it required rollups which compromised granularity when extending time windows.  Besides a ClickHouse review from a practitioner’s point of view, Sudeep tells us about interesting use-cases he’s working on at Salesforce.  ..read more
Visit website
How Preset Built a Data-Driven Organization from the Ground Up
The Data Engineering Show
by The Firebolt Data Bros
6M ago
According to Maxime Beauchemin, CEO & Founder at Preset and Creator of Apache Superset and Apache Airflow, it's not so straight-forward to understand what you're really getting into and the vastness of the skills that are required in order to build a thriving company. Picking the right system and services is key for a successful start, and can help you avoid the chaos of having too many tools spread across multiple teams. Plus, Max walks the bros through the genesis of Airflow, Superset & Presto, and Airflow's old school marketing approach that won the hearts of developers across the w ..read more
Visit website
How Similarweb Delivers Customer Facing Analytics Over 100s of TBs
The Data Engineering Show
by The Firebolt Data Bros
7M ago
According to Yoav Shmaria, VP R&D Platform at Similarweb, the best way to manage data warehouse costs is to tag every table, database or ETL running to have good granularity over every feature.   Besides handy cost management tips, Yoav walks the bros through the tech stack he implemented to analyze 100s of TBs of web data to serve fast customer-facing analytics. Full disclosure, Similarweb is a Firebolt customer, but the bros kept it objective, and there’s no Firebolt talk in this episode ..read more
Visit website
How Klarna Designed a New Data Platform in the Cloud
The Data Engineering Show
by The Firebolt Data Bros
8M ago
Klarna is one of the leading fintech companies in the world, valued at $45B.  While many corporations are “stuck” on-prem, Klarna made the move and today is a cloud-only company. Gunnar Tangring, Klarna’s Lead Data Engineer tells Boaz what this new modernized stack looks like ..read more
Visit website
How Eventbrite is Modernizing its Data Stack
The Data Engineering Show
by The Firebolt Data Bros
9M ago
Archana shares Eventbrite’s data stack modernization process, and how you get engineers to adopt new technologies like dbt which may be outside their comfort zone.   ..read more
Visit website
A Deep Dive into Slack's Data Architecture
The Data Engineering Show
by The Firebolt Data Bros
9M ago
Growing from a startup to an IPOed and then an acquired company meant that Slack’s sales org was scaling rapidly.  Apun Hiran, Slack’s Director of Software Engineering explains how the data stack and architecture evolved to support this growth with more reliable and timely metrics.  Speaker: Apun Hiran, Director of Software Engineering (Data), Slack Hosts: Eldad and Boaz Farkash, CEO and CPO, Firebolt ..read more
Visit website
Transitioning Scopely’s 5.5 PB Data Platform to the Modern Data Stack
The Data Engineering Show
by The Firebolt Data Bros
10M ago
Should data engineering AND BI be handled by the same people? According to Jonathan Palmer, VP Data Platform at Scopely – YES. By Analytics Engineers. His team of Analytics Engineers is in the final stages of transitioning 5.5 PBs of data which include 15B evens per day to the modern data stack. Tune in to learn how they did it ..read more
Visit website
Getting rid of raw data with Jens Larsson
The Data Engineering Show
by The Firebolt Data Bros
11M ago
Why would you create ugly data? According to Jens Larsson, don’t even go near raw data. Jens started off at Google, continued to manage data science at Spotify, and eventually joined Tink, an exciting new startup together with Spotify’s VP Analytics and his manager at the time. Jens explains how they killed the notion of raw data at Tink and walks us through Google and Spotify’s data stacks ..read more
Visit website
How Zendesk engineers manage customer-facing data applications
The Data Engineering Show
by The Firebolt Data Bros
1y ago
This time on the data engineering show, Eldad abandoned his brother Boaz but it’s ok because Boaz got the full 30 minutes to talk to one of the most interesting people in the data space.  Ananth Packkildurai is Principal Software Engineer at Zendesk and runs one of the strongest newsletters in data – Data Engineering Weekly. He talked about data applications at Zendesk and how they’re built, technologies that excite him like data lineage and data catalog, and the best routes for software engineers to get their hands dirty in the data world. INTERVIEWER: Boaz Farkash. ZENDESK GUEST:  ..read more
Visit website

Follow The Data Engineering Show on Feedspot

Continue with Google
OR