Walmart Labs Blog
0 FOLLOWERS
At Walmart Labs, a line of code can change the way the world shops. Walmart Labs is the technology arm of Walmart reimagining retail for our 260 million daily shoppers. Our teams of engineers, designers, and product leaders are experimenting for a smarter future.
Walmart Labs Blog
3y ago
How Do You Decide Whether an Individual Contributor (IC) or Engineering Manager Role is Right for You? Source: Pixabay
Are you at a junction where you ask “Should I pursue a role as an Engineering Manager (EM), or continue on the path of a sleeves-rolled-up code-writing Individual Contributor (IC)?”
Then this article is for YOU!
It is a common misconception that being a manager is just a higher-level version of what you were already doing. It’s definitely not! It’s a different mindset and a different set of problems that you will be working on. Some people believe the transition is a ..read more
Walmart Labs Blog
3y ago
What is HIPAA?
Health Insurance Portability and Accountability Act of 1996(HIPAA), is a law which provides standard to handle patient data and protected health information (PHI). HIPAA regulations are divided into several rules like- Privacy, Security, Transaction & Codes, Identifiers, Enforcement, Breach Notification, Omnibus final rule.
HIPAA Security rules provides guidance to protect individually identifiable health information which a system creates, receives, maintains, or transmits in electronic form. This information is called “electronic protected health information” (e ..read more
Walmart Labs Blog
3y ago
Photo by Michael Brunk on Unsplash
Writing asynchronous messaging applications and eventually-consistent systems provides many advantages, including:
Maximization of throughput — especially in cases where immediate consistency is not required
Offloading of workflows to provide an immediate response to a user
Ability to scale various portions of the workflow differently as needed
Support of backpressure around system bottlenecks
Modern platforms and frameworks have made writing asynchronous messaging systems very easy. Recently, I have had some time to explore Spring Cloud ..read more
Walmart Labs Blog
3y ago
Image Source: Google ImagesIntroduction:
In this article, we will use a data-driven approach to programmatically determine some of the aspects of the behavior of the Developers using the Stack Overflow developer survey data 2020. Stack Overflow yearly conducts surveys to better know about the IT Landscape from the perspective of the developers. The survey consists of a lot of questions ranging from developers’ hobbies, education, interests, work-related questions, etc.
Using the Stack Overflow data we will try to answer the following questions:
What are the major Job Factors the develope ..read more
Walmart Labs Blog
4y ago
Introduction
At WalmartLabs, we needed a platform to enable our business users to make smart data driven decisions by performing interactive analysis of huge datasets. This use-case requires an OLAP system that could process large chunks of data interactively. In order to do so, we decided to leverage ClickHouse (an open-source column-oriented DBMS), that could run analytical queries on billions of rows of data in sub seconds.
However, setting up and maintaining a database cluster that stores and processes terabytes of data could be a daunting task. Through this blog post, I’ll be sharing ..read more
Walmart Labs Blog
4y ago
Photo by Matt Botsford
Apache Cassandra is a distributed database system where data is always distributed and usually replicated across a cluster of machines which are referred to as Nodes. Deleting data is not the same in Cassandra as it is with a relational database. Unlike a relational database system, Cassandra does not remove the data immediately but simply captures the delete operation as a marker on that data which is called a Tombstone. This very fact presents the challenge of propagating deletes on the stored data. If not properly handled, this can become a performance bottleneck ..read more
Walmart Labs Blog
4y ago
Photo credit: Pixabay
Every day, credit card credentials are stolen by fraudsters who immediately try to purchase merchandise from many websites, including ours. This happens before the credit card owner and the bank can notice it, which means we need a fraud detection team fully dedicated to mitigating this risk.
At Walmart eCommerce, we process thousands of transactions every day and we need a team of Data Scientists, Engineers, and Product Managers to build, deploy, and maintain fraud detection algorithms.
How Data Science comes to the table?
From a product point of view, a p ..read more
Walmart Labs Blog
4y ago
Deep Dive into Azure Cosmos PartitionKey and Partitions
How to Effectively Model Azure Cosmos
Do you want to build an application with these features?
Highly scalable (read and write throughput)
Maintainable data consistency
Consistent business continuity during regional outages/disaster recovery
Then Cosmos DB is a perfect fit for your application. But you need a deep-dive understanding of how Cosmos works so you can model your application accordingly, and then you can achieve the desired throughput.
Partition Key Pre-requisites
A partition key is a unique dataset that has high cardina ..read more
Walmart Labs Blog
4y ago
Photo Credit: pixabayTable of Contents
Introduction
Building the Skeleton
- HTTP Endpoints
- Swagger
- Prometheus & Grafana
- Logging
- CICD Integration
Conclusion
Introduction
Custom frameworks are built and used in many organizations to make life easier for engineers. Any such framework is supposed to deliver a bundle of necessary features that we expect in every application, or as the organization demands, to make it standardized and reliable. This can range from specific logging format, using or restricting certain open source software, to enforcing versions, build tools or ..read more
Walmart Labs Blog
4y ago
Tech Modernization at scale — Blog Series Image credits: Pixabay
Platform refactoring initiatives go by various grandiose terms — Platform modernization, Tech refresh, Agile transformation, and DevOps transformation. The goal of these initiatives is primarily refactoring systems and reorganizing the teams that build and operate such systems. The correlation between these two — teams and systems — can’t be more succinctly expressed than what has become popular as Conway’s law, based on Melvin Conway’s article: “How do committees invent.”
“Any organization that designs a system (define ..read more