Software Engineering Daily

Software Engineering Daily

Policy Enforcement with Shimon Tolts

Feb 18 • 60 min

The nature of software projects is changing. Projects are using a wider variety of cloud providers and SaaS tools. Projects are being broken up into more git repositories, and the code in those repositories are being deployed into small microservices.…

Ethsimple: Ethereum Tools with Brian Soule

Feb 15 • 87 min

Ethereum allows developers to run decentralized applications. But the tooling for building and managing those decentralized applications is immature. Experienced software engineers have difficulty getting started with writing Ethereum applications because…

Kubernetes Security with Liz Rice

Feb 14 • 54 min

A Kubernetes cluster presents multiple potential attack surfaces: the cluster itself, a node running on the cluster, a pod running in the node, a container running in a pod. If you are managing your own Kubernetes cluster, you need to be aware of the…

Replicated: On-Prem Deployments with Grant Miller

Feb 13 • 63 min

Cloud computing has been popular for less than twenty years. Large software companies have existed for much longer. If your company was started before the cloud became popular, you probably have a large, data center on your companies premises. The…

Uber’s Monitoring Platform with Rob Skillington

Feb 12 • 59 min

Uber manages the car rides for millions of people. The Uber system must remain operational 24/7, and the app involves financial transactions and the safety of passengers. Uber infrastructure runs across thousands of server instances and produce terabytes…

Pachyderm: Data Pipelines with Joe Doliner

Feb 11 • 69 min

Data infrastructure is advancing beyond the days of Hadoop MapReduce, single-node databases, and nightly reporting. Companies are adopting modern data warehouses, streaming data systems, and cloud-specific data tools like BigQuery. Every company with a…

Knative: Serverless Workloads with Ville Aikas

Feb 8 • 59 min

Infrastructure software is having a renaissance. Cloud providers offer a wide range of deployment tools, including virtual machines, managed Kubernetes clusters, standalone container instances, and serverless functions. Kubernetes has standardized the…

VMware Kubernetes Strategy with Brad Meiseles

Feb 7 • 51 min

Virtualization software allows companies to get better utilization from their physical servers. A single physical host can manage multiple virtual machines using a hypervisor. VMware brought virtualization software to market, creating popular tools for…

Cadre: Automated Investing with Leonid Movsesyan

Feb 6 • 62 min

Real estate is an asset that is not straightforward to invest in. Real estate can generate excellent returns for investors, but can require much more time and expertise than stocks. Cadre is a company that allows users to invest in real estate more easily…

RocksDB with Dhruba Borthakur and Igor Canadi

Feb 5 • 66 min

RocksDB is a storage engine based on the log-structured merge tree data structure. RocksDB was developed at Facebook to provide a tool for embedded databases. The code for RocksDB is a fork of LevelDB, an embedded database built by Google for the Chrome…

Scaling HashiCorp with Armon Dadgar and Mitchell Hashimoto

Feb 4 • 58 min

HashiCorp was founded seven years ago with the goal of building infrastructure tools for automating cloud workflows such as provisioning, secret management, and service discovery. Hashicorp’s thesis was that operating cloud infrastructure was too hard:…

Engineering Philosophy with Tyler Cowen

Feb 1 • 64 min

Tyler Cowen’s book Stubborn Attachments outlines a framework that individuals can use to make decisions grounded in economic philosophy. In his previous books, Tyler examined recent economic history. Stubborn Attachments gives his perspective for…

Architects of Intelligence with Martin Ford

Jan 31 • 64 min

Artificial intelligence is reshaping every aspect of our lives, from transportation to agriculture to dating. Someday, we may even create a superintelligence–a computer system that is demonstrably smarter than humans. But there is widespread disagreement…

Anatomy of Next: New World with Mike Solana

Jan 30 • 70 min

Mars is a cold, inhospitable planet far from earth. It presents one of the most complex challenges faced by engineers: how can we create a new world? To create a new world, first we have to get there. We can build new rockets with improved propulsion…

Likewar: The Weaponization of Social Media with P.W. Singer

Jan 29 • 59 min

Social media has transformed our lives. It has also transformed how wars are fought. P.W. Singer’s new book “Likewar: The Weaponization of Social Media” describes the far-reaching impact of social media on the tactics and strategies used by military,…

Software Chasms with Martin Casado

Jan 28 • 64 min

Infrastructure software can be a great business. An infrastructure software company sells core technology to a large enterprise such as a bank or insurance company. This software has near zero marginal cost and generates a large annuity for the…

Kubeflow: TensorFlow on Kubernetes with David Aronchick

Jan 25 • 62 min

When TensorFlow came out of Google, the machine learning community converged around it. TensorFlow is a framework for building machine learning models, but the lifecycle of a machine learning model has a scope that is bigger than just creating a model.…

TiDB: Distributed NewSQL with Kevin Xu

Jan 24 • 72 min

When a user interacts with an application to order a ride with a ridesharing app, the data for that user interaction is written to a “transactional” database. A transactional database is a database where specific rows need to be written to and read from…

Storybook: UI Engineering with Zoltan Olah

Jan 23 • 55 min

React, Vue, and Angular are the most popular frontend JavaScript frameworks. Each of these frameworks lets frontend developers build components. A component is a high level visual abstraction that is used to compose a user interface. Frontend development…

RSocket: Reactive Streaming Service Networking with Ryland Degnan

Jan 22 • 66 min

Netflix has thousands of service instances communicating with each other. When a Netflix client on a smartphone makes a request for a movie, that request hits Netflix’s backend, where the request is fulfilled by a chain of requests through different…

Prometheus Scalability with Bryan Boreham

Jan 21 • 53 min

Prometheus is an open source monitoring system and time series database. Prometheus includes a multi-dimensional data model, a query language called PromQL, and a pull model for gathering metrics from your different services. Prometheus is widely used by…

Spot Instances with Amiram Shachar

Jan 18 • 65 min

When a developer provisions a cloud server, that server is called an “instance”. These instances can be used for running whatever workload a developer has, whether it is a web application, a database, or a set of containers. The cloud is cheap to get…

Looker: Business Intelligence Platform with Daniel Mintz

Jan 17 • 69 min

If a business has been operating successfully for a few years, that business has accumulated a high volume of data. That data exists in spreadsheets, CSV files, log files, and balance sheets. Data might be spread across local files on a user’s laptop,…

Human Sized Robots with Zach Allen

Jan 16 • 53 min

Robots are making their way into every area of our lives. Security robots roll around industrial parks at night, monitoring the area for intruders. Amazon robots tirelessly move packages around in warehouses, reducing the time and cost of logistics.…

Notebooks at Netflix with Matthew Seal

Jan 15 • 65 min

Netflix has petabytes of data and thousands of workloads running across that data every day. These workloads generate movie recommendations for users, create dashboards for data analysts to study, and reshape data in ETL jobs, to make it more accessible…

Kubernetes in China with Dan Kohn

Jan 14 • 59 min

Chinese Internet companies operate at a massive scale. WeChat has over a billion users and is widely used as the primary means of payment by urban Chinese consumers. Alibaba ships 12 million packages per day, which is four times the amount of Amazon.…

AWS Analysis with Corey Quinn

Jan 11 • 66 min

Amazon Web Services changed how software engineers work. Before AWS, it was common for startups to purchase their own physical servers. AWS made server resources as accessible as an API request, and has gone on to create higher-level abstractions for…

Zeit: Serverless Cloud with Guillermo Rauch

Jan 10 • 71 min

Serverless computing is a technique for deploying applications without an addressable server. A serverless application is running on servers, but the developer does not have access to the server in the traditional sense. The developer is not dealing with…

Cloud Events with Doug Davis

Jan 9 • 54 min

Functions-as-a-service allow developers to run their code in a “serverless” environment. A developer can provide a function to a cloud provider and the code for that function will be scheduled onto a container and executed whenever an event triggers that…

Multicloud with Ben Hindman

Jan 8 • 72 min

Most applications today are either deployed to on-premise environments or deployed to a single cloud provider. Developers who are deploying on-prem struggle to set up complicated open source tools like Kafka and Hadoop. Developers who are deploying to a…

Stateful Kubernetes with Saad Ali

Jan 7 • 60 min

In a cloud infrastructure environment, failures happen regularly. The servers can fail, the network can fail, and software bugs can crash your software unexpectedly. The amount of failures that can occur in cloud infrastructure is one reason why storage…

Kong API Platform with Marco Palladino

Jan 4 • 63 min

When a user makes a request to product like The New York Times, that request hits an API gateway. An API gateway is the entry point for an external request. An API gateway serves several purposes: authentication, security, routing, load balancing, and…

Ubiquity6: Augmented Reality Platform with Ankit Kumar

Jan 3 • 57 min

Augmented reality glasses will let us walk through a world where the digital blends together with the physical. 3-D objects will be rendered and superimposed onto our field of vision, creating an environment for people to build applications we can hardly…

Crossplane: Multicloud Control Plane with Bassam Tabbara

Jan 2 • 58 min

Cloud providers created the ability for developers to easily deploy their applications to servers on data centers. In the early days of the cloud, most of the code that a developer wrote for their application could run on any cloud provider, whether it…

Word2Vec with Adrian Colyer Holiday Repeat

Dec 28, 2018 • 61 min

Originally posted on 13 September 2017. Machines understand the world through mathematical representations. In order to train a machine learning model, we need to describe everything in terms of numbers. Images, words, and sounds are too abstract for a…

Self-Driving Deep Learning with Lex Fridman Holiday Repeat

Dec 27, 2018 • 59 min

Originally posted on 28 July 2017. Self-driving cars are here. Fully autonomous systems like Waymo are being piloted in less complex circumstances. Human-in-the-loop systems like Tesla Autopilot navigate drivers when it is safe to do so, and lets the…

Technology Utopia with Michael Solana Holiday Repeat

Dec 26, 2018 • 48 min

Originally posted on 1 May 2018. Technology is pushing us rapidly toward a future that is impossible to forecast. We try to imagine what that future might look like, and we can’t help having our predictions shaped by the media we have consumed. 1984,…

Google Early Days with John Looney Holiday Repeat

Dec 25, 2018 • 71 min

Originally posted on 16 June 2017. John Looney spent more than 10 years at Google. He started with infrastructure, and was part of the team that migrated Google File System to Colossus, the successor to GFS. Imagine migrating every piece of data on Google…

Service Proxying with Matt Klein Holiday Repeat

Dec 24, 2018 • 56 min

Originally posted on 14 February 2017. Most tech companies are moving toward a highly distributed microservices architecture. In this architecture, services are decoupled from each other and communicate with a common service language, often JSON over…

Rockset Data Platform with Venkat Venkataramani

Dec 21, 2018 • 59 min

At Facebook, Venkat Venkataramani saw how large volumes of data were changing software infrastructure. Applications such as logging servers and advertising were creating fast moving, semi-structured data. The user base was growing, the traffic was…

Modern Front End: React, GraphQL, VR, WebAssembly with Adam Conrad

Dec 20, 2018 • 66 min

Ten years ago, there was a distinction between “backend” and “frontend” developers. A backend developer would be managing the business logic and database transactions using Ruby on Rails or Java. A frontend developer would be responsible for implementing…

Linkerd Service Mesh with William Morgan

Dec 19, 2018 • 60 min

Software products are distributed across more and more servers as they grow. With the proliferation of cloud providers like AWS, these large infrastructure deployments have become much easier to create. With the maturity of Kubernetes, these distributed…

Market Strategy with Herb Cunitz

Dec 18, 2018 • 62 min

Market strategy defines how a company is positioning itself to be successful. This strategy encompasses engineering, sales, marketing, recruiting, and everything else within a company. Herb Cunitz has led teams at Hortonworks, VMware, SpringSource, and…

Mattermost: Self-Hosted Slack Alternative with Corey Hulen

Dec 17, 2018 • 63 min

Software companies today rely on group chat applications. The world of startups and small businesses is dominated by Slack. But for some large enterprises, regulatory constraints prevent them from using Slack. Slack is a web application that is hosted in…

Full Stack JavaScript with Wes Bos

Dec 14, 2018 • 61 min

Wes Bos has created popular courses on React, GraphQL, and JavaScript. With hundreds of thousands of students, Wes has earned a cult following for his fun, practical lessons on web development. The courses produced by Wes teach developers how to build…

Plaid: Banking API Platform with Jean-Denis Greze

Dec 13, 2018 • 63 min

A bank account is a platform for apps to be built on top of. If that sounds like a weird idea, think about the features of a bank account. Most users only have a single bank account, making it a tool for identity and authentication. The series of…

High Growth Handbook with Elad Gil

Dec 12, 2018 • 58 min

When a startup finds product market fit, the adoption of that product can grow rapidly, turning a startup into a high growth company. All of a sudden, a startup that was struggling to find its first customer is bombarded with new challenges. The startup…

Feature Flags with Edith Harbaugh

Dec 11, 2018 • 35 min

Releasing software has inherent risk. If your users don’t like your new feature, they might stop using your product immediately. If a software bug makes it into production, it can crash your entire application. Releasing software gradually has many…

Serverless Research with Ion Stoica

Dec 10, 2018 • 71 min

The Berkeley AMPLab was a research lab where Apache Spark and Apache Mesos were both created. In the last five years, the Mesos and Spark projects have changed the way infrastructure is managed and improved the tools for data science. Because of its…

Technical Investing with Sunil Dhaliwal

Dec 7, 2018 • 61 min

Robotics, genomics, and backend infrastructure: as an in vestor, it can be difficult to assess the viability of a startup that is on the cutting edge in any of these areas. A robotics startup requires a team with an integrated understanding of hardware…

RapidAPI: API Marketplace with Iddo Gino

Dec 6, 2018 • 59 min

Building software was simplified by cloud providers. With the cloud, it became much easier to deploy a server, spin up a database, and scale an application. Cloud providers like AWS gave developers access to these infrastructure primitives like storage…

Bitcoin Payment Channels with Alex Bosworth

Dec 5, 2018 • 60 min

The Bitcoin main chain is a large distributed ledger of transactions. Bitcoin is useful for maintaining a trusted record of payments, but is not practical for small day-to-day payments. Bitcoin payment channels allow users to issue small payments to each…

Streaming Platform Architecture with Luca Mezzalira and Yan Cui

Dec 4, 2018 • 51 min

Demand for live streaming video over the internet is increasing. After the emergence of early live streaming platforms, like Twitch and Facebook Live, more forms of video have become accessible over live streams, such as sports. Live streaming is a harder…

On-Prem Cloud with Bob Fraser

Dec 3, 2018 • 60 min

Not every company wants to move to the public cloud. Some companies have already built data centers, and can continue to operate their business with their own servers. Some companies have compliance issues with the public cloud, and want to operate their…

Anchor: Podcast Platform with Nir Zicherman

Nov 30, 2018 • 58 min

Podcasts have surged in popularity, but the podcast ecosystem remains difficult to work with. Podcast listeners have difficulty finding episodes. Podcast creators have difficulty finding out how to get started. The advertising marketplaces for podcasts…

Cloud Costs with Ran Rothschild

Nov 29, 2018 • 57 min

Cloud computing changed the economics of running a software company. Before the cloud, a software company had to purchase physical machines which often required thousands of dollars paid up front. The cloud allowed developers to deploy their applications…

Slack Messaging Architecture with Keith Adams

Nov 28, 2018 • 61 min

Slack is a real-time messaging system for work communication. On Slack, chat rooms as big as 100,000 people have productive conversations. This might sound like the same problem solved by social networks like Facebook, where billions of users communicate…

Facet Wealth Engineering with Gorkem Sevinc

Nov 27, 2018 • 60 min

Many people have saved some money which they want to invest for the future. Some people are happy investing their money in a roboadviser, which programmatically puts money into long-term investments. Other people want a more personal approach involving a…

Parity: Blockchain Infrastructure with Gavin Wood

Nov 26, 2018 • 55 min

Parity is a company that builds blockchain infrastructure. Parity has built several open source projects and works with enterprises to put blockchain technology in production. Gavin Wood is the founder of Parity, and he joins the show to talk about the…

Death and Distributed Systems with Pieter Hintjens Holiday Repeat

Nov 23, 2018 • 63 min

Originally posted on June 23, 2016. Pieter Hintjens grew up writing software by himself. The act of writing code brought him great pleasure, but the isolated creative process disconnected him from the rest of the world. As his life progressed he became…

Algorithms to Live By with Brian Christian Holiday Repeat

Nov 22, 2018 • 58 min

Originally posted on May 12, 2016. When you are deciding who to marry, you are using an algorithm. The same is true when you are looking for a parking space, playing a game of poker, or deciding whether or not to organize your closet. Algorithms To Live…

Poker Artificial Intelligence with Noam Brown Holiday Repeat

Nov 21, 2018 • 55 min

Originally posted on May 12, 2015. Humans have now been defeated by computers at heads up no-limit holdem poker. Some people thought this wouldn’t be possible. Sure, we can teach a computer to beat a human at Go or Chess. Those games have a smaller…

Salary Negotiation with Haseeb Qureshi Holiday Repeat

Nov 20, 2018 • 94 min

Featured Image Photo Credits Originally posted on July 11, 2016. Negotiation is an important skill for software engineers. The salary you negotiate at the beginning of your job could be a difference of tens of thousands of dollars over the course of an…

Schedulers with Adrian Cockcroft Holiday Repeat

Nov 19, 2018 • 58 min

Originally published on July 6, 2016. Scheduling is the method by which work is assigned to resources to complete that work. At the operating system level, this can mean scheduling of threads and processes. At the data center level, this can mean…

Reflow: Distributed Incremental Processing with Marius Eriksen

Nov 16, 2018 • 72 min

The volume of data in the world is always increasing. The costs of storing that data is always decreasing. And the means for processing that data is always evolving. Sensors, cameras, and other small computers gather large quantities of data from the…

Liquid Software with Baruch Sadogursky

Nov 15, 2018 • 59 min

The software release process is a barrier between written code and a live production environment that affects users. A software release process can involve a variety of different practices. Code might be tested for bugs using automation and manual…

SPIFFE: Zero Trust Workload Identification with Evan Gilman

Nov 14, 2018 • 59 min

Modern software consists of sprawling international networks of servers. Users contact these servers to access applications. Microservices talk to each other to fulfill complicated requests. Databases and machine learning frameworks crunch terabytes of…

Fission: Serverless on Kubernetes with Soam Vasani

Nov 13, 2018 • 63 min

Serverless computing abstracts away the idea of a server node. Serverless lets programmers treat compute resources as high-level, reliable APIs, rather than unreliable, low-level compute nodes that might fail. Serverless dramatically improves the…

Open Policy Agent with Torin Sandall

Nov 12, 2018 • 58 min

Policies define which users and applications can access and modify resources in a computer system. In a file system, a user might have permission to read or write to a file. In a cloud infrastructure deployment, a user might have the rights to deploy a…

TLA+ with Leslie Lamport

Nov 9, 2018 • 36 min

TLA+ is a formal specification language. TLA+ is used to design, model, and verify concurrent systems. TLA+ allows a user to describe a system formally with simple, precise mathematics. TLA+ was designed by Leslie Lamport, a computer scientist and Turing…

Computer Vision with Peter Kontschieder

Nov 8, 2018 • 61 min

Mapillary is a company that processes high volumes of images to develop a labeled 3-D model of the physical world. Mapillary’s APIs allow developers to build applications that are aware of stop signs, buildings, streets, trees, and other physical objects…

Computer Architecture with Dave Patterson

Nov 7, 2018 • 51 min

An instruction set defines a low level programming language for moving information throughout a computer. In the early 1970’s, the prevalent instruction set language used a large vocabulary of different instructions. One justification for a large…

OSS Capital with Joseph Jacks

Nov 6, 2018 • 63 min

Open source projects benefit from the network effects of a large audience of developers. A popular open source project will be contributed to and used by thousands of developers, who are continuously testing, deploying, and improving the software. The…

Commons Clause with Kevin Wang

Nov 5, 2018 • 63 min

Open source software powers everything we do on the Internet. Google runs on Linux servers. Content sites are served by WordPress. Our data is queued in Kafka clusters and stored in MongoDB instances. The success of an open source project often leads to…

Scaling Lyft with Matt Klein

Nov 2, 2018 • 57 min

Matt Klein has worked for three rapidly growing Internet companies. At AWS, he worked on EC2, the compute-as-a-service product that powers a large percentage of the Internet. At Twitter, he helped scale the infrastructure in the chaotic days before…

Wonolo: Staffing Marketplace with Jeremy Burton

Nov 1, 2018 • 56 min

Online labor marketplaces are widely used for one-to-one transactions. On Uber, a rider hires a driver for transportation. On TaskRabbit, a homeowner hires a cleaner to come clean their kitchen. These types of marketplaces are not as widely used for…

Diffbot: Knowledge Graph API with Mike Tung

Oct 31, 2018 • 57 min

Google Search allows humans to find and access information across the web. A human enters an unstructured query into the search box, the search engine provides several links as a result, and the human clicks on one of those links. That link brings up a…

Drift: Sales Bot Engineering with David Cancel

Oct 30, 2018 • 60 min

David Cancel has started five companies, most recently Drift. Drift is a conversational marketing and sales platform. David has a depth of engineering skills and a breadth of business experience that make him an amazing source of knowledge. In today’s…

Building a Hiring Process with Ammon Bartram

Oct 29, 2018 • 54 min

Engineers who start companies often find themselves building something they have no experience with: a hiring process. Hiring engineers today is not as systematic as building software. We don’t have lots of data that tells us what makes for an effective…

Gig Economy

Oct 28, 2018 • 53 min

I like to write music, and a year ago I started working on an album called “Gig Economy”. The plan for the album was to hire musicians from gig economy platforms like Fiverr and Upwork to perform on songs that I produced. The album is finished and I’m…

Blockchain Distribution Network with Aleksandar Kuzmanovic

Oct 26, 2018 • 78 min

Cryptocurrencies are not very usable today. The main use cases for cryptocurrencies today are store of value (somewhat like gold) and speculation. One reason that the use cases are so narrow is the problem of scalability. Cryptocurrencies have several…

Flogo: Event-Driven Ecosystem with Leon Stigter and Matt Ellis

Oct 25, 2018 • 52 min

A smart security camera takes in a high volume of video images and processes those images using a set of machine learning models. Those models can be used to identify interesting snippets of movement throughout the day, and decide which of those snippets…

JAM Stack with Phil Hawksworth

Oct 24, 2018 • 56 min

Engineers can build applications faster by using tools that abstract away infrastructure. Major cloud providers offer this tooling in the form of functions-as-a-service, as well as managed services such as Google BigQuery or Azure Container Instances. The…

DevSecOps with Edward Thomson

Oct 23, 2018 • 55 min

DevSecOps emphasizes moving security out of a siloed audit process and distributing security practices throughout the software supply chain. In the past, software development usually followed a waterfall development process. Each step in building software…

Google JavaScript with Malte Ubl

Oct 22, 2018 • 65 min

Google Search is a highly interactive JavaScript application. As you enter a query, results are being automatically suggested to you before you even finish typing. When you press enter, some of your search results may be widgets that represent the…

AWS Containers with Deepak Singh

Oct 19, 2018 • 52 min

Deepak Singh is the director of compute services at AWS, where he works on cloud products relating to containers, Linux, and High Performance Computing. In today’s show, Deepak describes how the market for containers and serverless has evolved, and how…

Open Source Product Strategy with Shaun Connolly

Oct 18, 2018 • 63 min

Linux has created much more value for Google than it has for Linus Torvalds. Ruby on Rails has created more value for Airbnb than it has for David Heinemeier Hansson. Successful open source projects create more value than their creators’ capture–and…

Cloud Search with Liam Cavanagh

Oct 17, 2018 • 51 min

Search is part of almost every application. Users search for movies to watch. Engineers search through terabytes of log messages to find exceptions. Drivers search through maps to find a destination. Search remains an unsolved problem, with lots of room…

Open vSwitch: Virtual Networking with Ben Pfaff

Oct 16, 2018 • 43 min

Virtual machines are operating system instances that run alongside each other on the same physical host. The virtual machines running on a physical host are managed by a hypervisor running on the physical host. A cluster of two physical servers could have…

Data Warehouse with Christian Kleinerman

Oct 15, 2018 • 63 min

A data warehouse provides fast access to large data sets for analytics, data science, and dashboards. A data warehouse differs from a transactional database, because you often do not need to update specific records. Because of the read-only nature of the…

DevOps at Microsoft with Martin Woodward

Oct 12, 2018 • 64 min

The Windows operating system is one of the most widely used pieces of software in history. Windows was started before there was any alternative to a monolithic codebase, because Microsoft was building software before the Internet was widely used by…

Generative Models with Doug Eck

Oct 11, 2018 • 68 min

Google Brain is an engineering team focused on deep learning research and applications. One growing area of interest within Google Brain is that of generative models. A generative model uses neural networks and a large data set to create new data similar…

Mapillary: Computer Vision Crowdsourcing with Peter Neubauer

Oct 10, 2018 • 67 min

Mapillary is a platform for gathering photos taken by smartphones and using that data to build a 3D model of the world. Mapillary’s model of the world includes labeled objects such as traffic signs, trees, humans, and buildings. This 3D model can be…

Digital Privacy with Aran Khanna

Oct 9, 2018 • 62 min

When Aran Khanna was a college student, he accepted an internship to work at Facebook. Even before his internship started, he started playing around with Facebook’s APIs and applications. Aran built a Chrome extension called Marauder’s Map, which used…

Airbnb Engineering with Surabhi Gupta

Oct 8, 2018 • 51 min

Airbnb began in 2008 as a monolithic Rails application serving the simple purpose of listing homes for rental. Over time, the number of listings increased dramatically, as did the number of people who were renting. With that scale, the Rails app had to be…

Monolith Migration with Jan Schiffman and Sherman Wood

Oct 6, 2018 • 50 min

We previously released this episode with the wrong audio file and are re-releasing it on a weekend. TIBCO was started in the 90’s with a popular message bus product that was widely used by finance companies, logistics providers, and other systems with…

Scalyr: Column-Oriented Log Management with Steve Newman

Oct 5, 2018 • 59 min

Log messages are fast, high volume, unstructured data. Logs are often the source of metrics, alerts, and dashboards, so these critical systems are downstream from a log management system. A log management system needs to be highly available, so that a…

Database Performance and Optimization with Andrew Davidson

Oct 4, 2018 • 66 min

When a database gets large, it can start to perform poorly. This can manifest in slow query speed. You can speed up a query by defining an index, which is a data structure that allows for faster access to the data that is being indexed. As a consequence,…

Cursor: Data Collaboration with Adam Weinstein

Oct 3, 2018 • 54 min

Linkedin is an organization with thousands of employees. An enterprise of that size starts to develop problems with data collaboration. Data collaboration is the process of sharing and analyzing data with multiple users, such as data scientists, business…

Kotlin Design with Andrey Breslav

Oct 2, 2018 • 48 min

Kotlin is a statically typed programming language that started as a JVM language. It gained popularity because it reduces the amount of boilerplate code required for a typical Java project. Many of the early adopters of Kotlin were building Android apps…