Improving Meta’s global maps
Meta Engineering
by
2d ago
A lot has changed since the initial launch of our basemap in late 2020. We’re Meta now, but our mission remains the same: Giving people the power to build community and bring the world closer together. Across Meta, our family of applications (Facebook, Instagram, WhatsApp, among others) are using our basemap to connect people through functions like status updates, location sharing, and location-based searching. In late 2020, Meta launched its basemap. This global, multi-scale map serves as a foundational layer — showing a variety of geographic features onto which we can blend other data, suc ..read more
Visit website
Asynchronous computing at Meta: Overview and learnings
Meta Engineering
by
1w ago
We’ve made architecture changes to Meta’s event driven asynchronous computing platform that have  enabled easy integration with multiple event-sources.  We’re sharing our learnings from handling various workloads and how to tackle trade offs made with certain design choices in building the platform. Asynchronous computing is a paradigm where the user does not expect a workload to be executed immediately; instead, it gets scheduled for execution sometime in the near future without blocking the latency-critical path of the application. At Meta, we have built a platform for serverless ..read more
Visit website
Watch Meta’s engineers discuss optimizing large-scale networks
Meta Engineering
by
1w ago
Managing network solutions amidst a growing scale inherently brings challenges around performance, deployment, and operational complexities.  At Meta, we’ve found that these challenges broadly fall into three themes: 1.)   Data center networking: Over the past decade, on the physical front, we have seen a rise in vendor-specific hardware that comes with heterogeneous feature and architecture sets (e.g., non-blocking architecture). On the software side, there has been a massive increase in scale and capacity demand (in the order of magnitude of MWs per physical building) to manage hyp ..read more
Visit website
Watch Meta’s engineers discuss optimizing large-scale networks
Meta Engineering
by
1w ago
Managing network solutions amidst a growing scale inherently brings challenges around performance, deployment, and operational complexities.  At Meta, we’ve found that these challenges broadly fall into three themes: 1.)   Data center networking: Over the past decade, on the physical front, we have seen a rise in vendor-specific hardware that comes with heterogeneous feature and architecture sets (e.g., non-blocking architecture). On the software side, there has been a massive increase in scale and capacity demand (in the order of magnitude of MWs per physical building) to manage hyp ..read more
Visit website
Tulip: Modernizing Meta’s data platform
Meta Engineering
by
1w ago
The technical journey discusses the motivations, challenges, and technical solutions employed for warehouse schematization, especially a change to the wire serialization format employed in Meta’s data platform for data interchange related to Warehouse Analytics Logging. Here, we discuss the engineering, scaling, and nontechnical challenges of modernizing  Meta’s exabyte-scale data platform by migrating to the new Tulip format.  Schematization of data plays an important role for a data platform of this scale. It affects performance, efficiency, reliability, and developer experience a ..read more
Visit website
Open-sourcing Anonymous Credential Service
Meta Engineering
by
2M ago
Meta has open-sourced Anonymous Credential Service (ACS), a highly available multitenant service that allows clients to authenticate in a de-identified manner. ACS enhances privacy and security while also being compute-conscious. By open-sourcing and fostering a community for ACS, we believe we can accelerate the pace of innovation in de-identified authentication. Data minimization — collecting the minimum amount of data required to support our services — is one of our core principles at Meta as we develop new privacy-enhancing technologies to protect user data on our family of products. The ..read more
Visit website
Enabling static analysis of SQL queries at Meta
Meta Engineering
by
2M ago
UPM is our internal standalone library to perform static analysis of SQL code and enhance SQL authoring.  UPM takes SQL code as input and represents it as a data structure called a semantic tree. Infrastructure teams at Meta leverage UPM to build SQL linters, catch user mistakes in SQL code, and perform data lineage analysis at scale. Executing SQL queries against our data warehouse is important to the workflows of many engineers and data scientists at Meta for analytics and monitoring use cases, either as part of recurring data pipelines or for ad-hoc data exploration.  While SQL ..read more
Visit website
Retrofitting null-safety onto Java at Meta
Meta Engineering
by
2M ago
We developed a new static analysis tool called Nullsafe that is used at Meta to detect NullPointerException (NPE) errors in Java code. Interoperability with legacy code and gradual deployment model were key to Nullsafe’s wide adoption and allowed us to recover some null-safety properties in the context of an otherwise null-unsafe language in a multimillion-line codebase. Nullsafe has helped significantly reduce the overall number of NPE errors and improved developers’ productivity. This shows the value of static analysis in solving real-world problems at scale. Null dereferencing is a common ..read more
Visit website
PTP: Timing accuracy and precision for the future of computing
Meta Engineering
by
2M ago
Meta is deploying a timing protocol, Precision Time Protocol (PTP), that will offer new levels of accuracy and precision to our networks and data centers. We believe PTP will become the global standard for keeping time in computer networks. PTP will benefit today’s products and services and will be a foundational technology behind the development of the metaverse. To help support industry adoption, we’ve open-sourced our network hardware and software designed to support PTP. Meta is deploying a network timing protocol, Precision Time Protocol (PTP), to improve the accuracy and precision acr ..read more
Visit website
How Precision Time Protocol is being deployed at Meta
Meta Engineering
by
2M ago
Implementing Precision Time Protocol (PTP) at Meta allows us to synchronize the systems that drive our products and services down to nanosecond precision. PTP’s predecessor, Network Time Protocol (NTP), provided us with millisecond precision, but as we scale to more advanced systems on our way to building the next computing platform, the metaverse and AI, we need to ensure that our servers are keeping time as accurately and precisely as possible. With PTP in place, we’ll be able to enhance Meta’s technologies and programs — from communications and productivity to entertainment, privacy, and se ..read more
Visit website

Follow Meta Engineering on Feedspot

Continue with Google
OR