Software Engineering Daily

Software Engineering Daily

softwareengineeringdaily.com
Technical interviews about software topics.
Policy Enforcement with Shimon Tolts
Feb 18 • 60 min
The nature of software projects is changing. Projects are using a wider variety of cloud providers and SaaS tools. Projects are being broken up into more git repositories, and the code in those repositories are being deployed into small microservices.…
Ethsimple: Ethereum Tools with Brian Soule
Feb 15 • 87 min
Ethereum allows developers to run decentralized applications. But the tooling for building and managing those decentralized applications is immature. Experienced software engineers have difficulty getting started with writing Ethereum applications because…
Kubernetes Security with Liz Rice
Feb 14 • 54 min
A Kubernetes cluster presents multiple potential attack surfaces: the cluster itself, a node running on the cluster, a pod running in the node, a container running in a pod. If you are managing your own Kubernetes cluster, you need to be aware of the…
Replicated: On-Prem Deployments with Grant Miller
Feb 13 • 63 min
Cloud computing has been popular for less than twenty years. Large software companies have existed for much longer. If your company was started before the cloud became popular, you probably have a large, data center on your companies premises. The…
Uber’s Monitoring Platform with Rob Skillington
Feb 12 • 59 min
Uber manages the car rides for millions of people. The Uber system must remain operational 24/7, and the app involves financial transactions and the safety of passengers. Uber infrastructure runs across thousands of server instances and produce terabytes…
Pachyderm: Data Pipelines with Joe Doliner
Feb 11 • 69 min
Data infrastructure is advancing beyond the days of Hadoop MapReduce, single-node databases, and nightly reporting. Companies are adopting modern data warehouses, streaming data systems, and cloud-specific data tools like BigQuery. Every company with a…
Knative: Serverless Workloads with Ville Aikas
Feb 8 • 59 min
Infrastructure software is having a renaissance. Cloud providers offer a wide range of deployment tools, including virtual machines, managed Kubernetes clusters, standalone container instances, and serverless functions. Kubernetes has standardized the…
VMware Kubernetes Strategy with Brad Meiseles
Feb 7 • 51 min
Virtualization software allows companies to get better utilization from their physical servers. A single physical host can manage multiple virtual machines using a hypervisor. VMware brought virtualization software to market, creating popular tools for…
Cadre: Automated Investing with Leonid Movsesyan
Feb 6 • 62 min
Real estate is an asset that is not straightforward to invest in. Real estate can generate excellent returns for investors, but can require much more time and expertise than stocks. Cadre is a company that allows users to invest in real estate more easily…
RocksDB with Dhruba Borthakur and Igor Canadi
Feb 5 • 66 min
RocksDB is a storage engine based on the log-structured merge tree data structure. RocksDB was developed at Facebook to provide a tool for embedded databases. The code for RocksDB is a fork of LevelDB, an embedded database built by Google for the Chrome…
Scaling HashiCorp with Armon Dadgar and Mitchell Hashimoto
Feb 4 • 58 min
HashiCorp was founded seven years ago with the goal of building infrastructure tools for automating cloud workflows such as provisioning, secret management, and service discovery. Hashicorp’s thesis was that operating cloud infrastructure was too hard:…
Engineering Philosophy with Tyler Cowen
Feb 1 • 64 min
Tyler Cowen’s book Stubborn Attachments outlines a framework that individuals can use to make decisions grounded in economic philosophy. In his previous books, Tyler examined recent economic history. Stubborn Attachments gives his perspective for…
Architects of Intelligence with Martin Ford
Jan 31 • 64 min
Artificial intelligence is reshaping every aspect of our lives, from transportation to agriculture to dating. Someday, we may even create a superintelligence–a computer system that is demonstrably smarter than humans. But there is widespread disagreement…
Anatomy of Next: New World with Mike Solana
Jan 30 • 70 min
Mars is a cold, inhospitable planet far from earth. It presents one of the most complex challenges faced by engineers: how can we create a new world? To create a new world, first we have to get there. We can build new rockets with improved propulsion…
Likewar: The Weaponization of Social Media with P.W. Singer
Jan 29 • 59 min
Social media has transformed our lives. It has also transformed how wars are fought. P.W. Singer’s new book “Likewar: The Weaponization of Social Media” describes the far-reaching impact of social media on the tactics and strategies used by military,…
Software Chasms with Martin Casado
Jan 28 • 64 min
Infrastructure software can be a great business. An infrastructure software company sells core technology to a large enterprise such as a bank or insurance company. This software has near zero marginal cost and generates a large annuity for the…
Kubeflow: TensorFlow on Kubernetes with David Aronchick
Jan 25 • 62 min
When TensorFlow came out of Google, the machine learning community converged around it. TensorFlow is a framework for building machine learning models, but the lifecycle of a machine learning model has a scope that is bigger than just creating a model.…
TiDB: Distributed NewSQL with Kevin Xu
Jan 24 • 72 min
When a user interacts with an application to order a ride with a ridesharing app, the data for that user interaction is written to a “transactional” database. A transactional database is a database where specific rows need to be written to and read from…
Storybook: UI Engineering with Zoltan Olah
Jan 23 • 55 min
React, Vue, and Angular are the most popular frontend JavaScript frameworks. Each of these frameworks lets frontend developers build components. A component is a high level visual abstraction that is used to compose a user interface. Frontend development…
RSocket: Reactive Streaming Service Networking with Ryland Degnan
Jan 22 • 66 min
Netflix has thousands of service instances communicating with each other. When a Netflix client on a smartphone makes a request for a movie, that request hits Netflix’s backend, where the request is fulfilled by a chain of requests through different…
Prometheus Scalability with Bryan Boreham
Jan 21 • 53 min
Prometheus is an open source monitoring system and time series database. Prometheus includes a multi-dimensional data model, a query language called PromQL, and a pull model for gathering metrics from your different services. Prometheus is widely used by…
Spot Instances with Amiram Shachar
Jan 18 • 65 min
When a developer provisions a cloud server, that server is called an “instance”. These instances can be used for running whatever workload a developer has, whether it is a web application, a database, or a set of containers. The cloud is cheap to get…
Looker: Business Intelligence Platform with Daniel Mintz
Jan 17 • 69 min
If a business has been operating successfully for a few years, that business has accumulated a high volume of data. That data exists in spreadsheets, CSV files, log files, and balance sheets. Data might be spread across local files on a user’s laptop,…
Human Sized Robots with Zach Allen
Jan 16 • 53 min
Robots are making their way into every area of our lives. Security robots roll around industrial parks at night, monitoring the area for intruders. Amazon robots tirelessly move packages around in warehouses, reducing the time and cost of logistics.…
Notebooks at Netflix with Matthew Seal
Jan 15 • 65 min
Netflix has petabytes of data and thousands of workloads running across that data every day. These workloads generate movie recommendations for users, create dashboards for data analysts to study, and reshape data in ETL jobs, to make it more accessible…
Kubernetes in China with Dan Kohn
Jan 14 • 59 min
Chinese Internet companies operate at a massive scale. WeChat has over a billion users and is widely used as the primary means of payment by urban Chinese consumers. Alibaba ships 12 million packages per day, which is four times the amount of Amazon.…
AWS Analysis with Corey Quinn
Jan 11 • 66 min
Amazon Web Services changed how software engineers work. Before AWS, it was common for startups to purchase their own physical servers. AWS made server resources as accessible as an API request, and has gone on to create higher-level abstractions for…
Zeit: Serverless Cloud with Guillermo Rauch
Jan 10 • 71 min
Serverless computing is a technique for deploying applications without an addressable server. A serverless application is running on servers, but the developer does not have access to the server in the traditional sense. The developer is not dealing with…
Cloud Events with Doug Davis
Jan 9 • 54 min
Functions-as-a-service allow developers to run their code in a “serverless” environment. A developer can provide a function to a cloud provider and the code for that function will be scheduled onto a container and executed whenever an event triggers that…
Multicloud with Ben Hindman
Jan 8 • 72 min
Most applications today are either deployed to on-premise environments or deployed to a single cloud provider. Developers who are deploying on-prem struggle to set up complicated open source tools like Kafka and Hadoop. Developers who are deploying to a…
Stateful Kubernetes with Saad Ali
Jan 7 • 60 min
In a cloud infrastructure environment, failures happen regularly. The servers can fail, the network can fail, and software bugs can crash your software unexpectedly. The amount of failures that can occur in cloud infrastructure is one reason why storage…
Kong API Platform with Marco Palladino
Jan 4 • 63 min
When a user makes a request to product like The New York Times, that request hits an API gateway. An API gateway is the entry point for an external request. An API gateway serves several purposes: authentication, security, routing, load balancing, and…
Ubiquity6: Augmented Reality Platform with Ankit Kumar
Jan 3 • 57 min
Augmented reality glasses will let us walk through a world where the digital blends together with the physical. 3-D objects will be rendered and superimposed onto our field of vision, creating an environment for people to build applications we can hardly…
Crossplane: Multicloud Control Plane with Bassam Tabbara
Jan 2 • 58 min
Cloud providers created the ability for developers to easily deploy their applications to servers on data centers. In the early days of the cloud, most of the code that a developer wrote for their application could run on any cloud provider, whether it…
Word2Vec with Adrian Colyer Holiday Repeat
Dec 28, 2018 • 61 min
Originally posted on 13 September 2017. Machines understand the world through mathematical representations. In order to train a machine learning model, we need to describe everything in terms of numbers. Images, words, and sounds are too abstract for a…
Self-Driving Deep Learning with Lex Fridman Holiday Repeat
Dec 27, 2018 • 59 min
Originally posted on 28 July 2017. Self-driving cars are here. Fully autonomous systems like Waymo are being piloted in less complex circumstances. Human-in-the-loop systems like Tesla Autopilot navigate drivers when it is safe to do so, and lets the…
Technology Utopia with Michael Solana Holiday Repeat
Dec 26, 2018 • 48 min
Originally posted on 1 May 2018. Technology is pushing us rapidly toward a future that is impossible to forecast. We try to imagine what that future might look like, and we can’t help having our predictions shaped by the media we have consumed. 1984,…
Google Early Days with John Looney Holiday Repeat
Dec 25, 2018 • 71 min
Originally posted on 16 June 2017. John Looney spent more than 10 years at Google. He started with infrastructure, and was part of the team that migrated Google File System to Colossus, the successor to GFS. Imagine migrating every piece of data on Google…
Service Proxying with Matt Klein Holiday Repeat
Dec 24, 2018 • 56 min
Originally posted on 14 February 2017. Most tech companies are moving toward a highly distributed microservices architecture. In this architecture, services are decoupled from each other and communicate with a common service language, often JSON over…
Rockset Data Platform with Venkat Venkataramani
Dec 21, 2018 • 59 min
At Facebook, Venkat Venkataramani saw how large volumes of data were changing software infrastructure. Applications such as logging servers and advertising were creating fast moving, semi-structured data. The user base was growing, the traffic was…
Modern Front End: React, GraphQL, VR, WebAssembly with Adam Conrad
Dec 20, 2018 • 66 min
Ten years ago, there was a distinction between “backend” and “frontend” developers. A backend developer would be managing the business logic and database transactions using Ruby on Rails or Java. A frontend developer would be responsible for implementing…
Linkerd Service Mesh with William Morgan
Dec 19, 2018 • 60 min
Software products are distributed across more and more servers as they grow. With the proliferation of cloud providers like AWS, these large infrastructure deployments have become much easier to create. With the maturity of Kubernetes, these distributed…
Market Strategy with Herb Cunitz
Dec 18, 2018 • 62 min
Market strategy defines how a company is positioning itself to be successful. This strategy encompasses engineering, sales, marketing, recruiting, and everything else within a company. Herb Cunitz has led teams at Hortonworks, VMware, SpringSource, and…
Mattermost: Self-Hosted Slack Alternative with Corey Hulen
Dec 17, 2018 • 63 min
Software companies today rely on group chat applications. The world of startups and small businesses is dominated by Slack. But for some large enterprises, regulatory constraints prevent them from using Slack. Slack is a web application that is hosted in…
Full Stack JavaScript with Wes Bos
Dec 14, 2018 • 61 min
Wes Bos has created popular courses on React, GraphQL, and JavaScript. With hundreds of thousands of students, Wes has earned a cult following for his fun, practical lessons on web development. The courses produced by Wes teach developers how to build…
Plaid: Banking API Platform with Jean-Denis Greze
Dec 13, 2018 • 63 min
A bank account is a platform for apps to be built on top of. If that sounds like a weird idea, think about the features of a bank account. Most users only have a single bank account, making it a tool for identity and authentication. The series of…
High Growth Handbook with Elad Gil
Dec 12, 2018 • 58 min
When a startup finds product market fit, the adoption of that product can grow rapidly, turning a startup into a high growth company. All of a sudden, a startup that was struggling to find its first customer is bombarded with new challenges. The startup…
Feature Flags with Edith Harbaugh
Dec 11, 2018 • 35 min
Releasing software has inherent risk. If your users don’t like your new feature, they might stop using your product immediately. If a software bug makes it into production, it can crash your entire application. Releasing software gradually has many…
Serverless Research with Ion Stoica
Dec 10, 2018 • 71 min
The Berkeley AMPLab was a research lab where Apache Spark and Apache Mesos were both created. In the last five years, the Mesos and Spark projects have changed the way infrastructure is managed and improved the tools for data science. Because of its…
Technical Investing with Sunil Dhaliwal
Dec 7, 2018 • 61 min
Robotics, genomics, and backend infrastructure: as an in vestor, it can be difficult to assess the viability of a startup that is on the cutting edge in any of these areas. A robotics startup requires a team with an integrated understanding of hardware…
RapidAPI: API Marketplace with Iddo Gino
Dec 6, 2018 • 59 min
Building software was simplified by cloud providers. With the cloud, it became much easier to deploy a server, spin up a database, and scale an application. Cloud providers like AWS gave developers access to these infrastructure primitives like storage…
Bitcoin Payment Channels with Alex Bosworth
Dec 5, 2018 • 60 min
The Bitcoin main chain is a large distributed ledger of transactions. Bitcoin is useful for maintaining a trusted record of payments, but is not practical for small day-to-day payments. Bitcoin payment channels allow users to issue small payments to each…
Streaming Platform Architecture with Luca Mezzalira and Yan Cui
Dec 4, 2018 • 51 min
Demand for live streaming video over the internet is increasing. After the emergence of early live streaming platforms, like Twitch and Facebook Live, more forms of video have become accessible over live streams, such as sports. Live streaming is a harder…
On-Prem Cloud with Bob Fraser
Dec 3, 2018 • 60 min
Not every company wants to move to the public cloud. Some companies have already built data centers, and can continue to operate their business with their own servers. Some companies have compliance issues with the public cloud, and want to operate their…
Anchor: Podcast Platform with Nir Zicherman
Nov 30, 2018 • 58 min
Podcasts have surged in popularity, but the podcast ecosystem remains difficult to work with. Podcast listeners have difficulty finding episodes. Podcast creators have difficulty finding out how to get started. The advertising marketplaces for podcasts…
Cloud Costs with Ran Rothschild
Nov 29, 2018 • 57 min
Cloud computing changed the economics of running a software company. Before the cloud, a software company had to purchase physical machines which often required thousands of dollars paid up front. The cloud allowed developers to deploy their applications…
Slack Messaging Architecture with Keith Adams
Nov 28, 2018 • 61 min
Slack is a real-time messaging system for work communication. On Slack, chat rooms as big as 100,000 people have productive conversations. This might sound like the same problem solved by social networks like Facebook, where billions of users communicate…
Facet Wealth Engineering with Gorkem Sevinc
Nov 27, 2018 • 60 min
Many people have saved some money which they want to invest for the future. Some people are happy investing their money in a roboadviser, which programmatically puts money into long-term investments. Other people want a more personal approach involving a…
Parity: Blockchain Infrastructure with Gavin Wood
Nov 26, 2018 • 55 min
Parity is a company that builds blockchain infrastructure. Parity has built several open source projects and works with enterprises to put blockchain technology in production. Gavin Wood is the founder of Parity, and he joins the show to talk about the…
Death and Distributed Systems with Pieter Hintjens Holiday Repeat
Nov 23, 2018 • 63 min
Originally posted on June 23, 2016. Pieter Hintjens grew up writing software by himself. The act of writing code brought him great pleasure, but the isolated creative process disconnected him from the rest of the world. As his life progressed he became…
Algorithms to Live By with Brian Christian Holiday Repeat
Nov 22, 2018 • 58 min
Originally posted on May 12, 2016. When you are deciding who to marry, you are using an algorithm. The same is true when you are looking for a parking space, playing a game of poker, or deciding whether or not to organize your closet. Algorithms To Live…
Poker Artificial Intelligence with Noam Brown Holiday Repeat
Nov 21, 2018 • 55 min
Originally posted on May 12, 2015. Humans have now been defeated by computers at heads up no-limit holdem poker. Some people thought this wouldn’t be possible. Sure, we can teach a computer to beat a human at Go or Chess. Those games have a smaller…
Salary Negotiation with Haseeb Qureshi Holiday Repeat
Nov 20, 2018 • 94 min
Featured Image Photo Credits Originally posted on July 11, 2016. Negotiation is an important skill for software engineers. The salary you negotiate at the beginning of your job could be a difference of tens of thousands of dollars over the course of an…
Schedulers with Adrian Cockcroft Holiday Repeat
Nov 19, 2018 • 58 min
Originally published on July 6, 2016. Scheduling is the method by which work is assigned to resources to complete that work. At the operating system level, this can mean scheduling of threads and processes. At the data center level, this can mean…
Reflow: Distributed Incremental Processing with Marius Eriksen
Nov 16, 2018 • 72 min
The volume of data in the world is always increasing. The costs of storing that data is always decreasing. And the means for processing that data is always evolving. Sensors, cameras, and other small computers gather large quantities of data from the…
Liquid Software with Baruch Sadogursky
Nov 15, 2018 • 59 min
The software release process is a barrier between written code and a live production environment that affects users. A software release process can involve a variety of different practices. Code might be tested for bugs using automation and manual…
SPIFFE: Zero Trust Workload Identification with Evan Gilman
Nov 14, 2018 • 59 min
Modern software consists of sprawling international networks of servers. Users contact these servers to access applications. Microservices talk to each other to fulfill complicated requests. Databases and machine learning frameworks crunch terabytes of…
Fission: Serverless on Kubernetes with Soam Vasani
Nov 13, 2018 • 63 min
Serverless computing abstracts away the idea of a server node. Serverless lets programmers treat compute resources as high-level, reliable APIs, rather than unreliable, low-level compute nodes that might fail. Serverless dramatically improves the…
Open Policy Agent with Torin Sandall
Nov 12, 2018 • 58 min
Policies define which users and applications can access and modify resources in a computer system. In a file system, a user might have permission to read or write to a file. In a cloud infrastructure deployment, a user might have the rights to deploy a…
TLA+ with Leslie Lamport
Nov 9, 2018 • 36 min
TLA+ is a formal specification language. TLA+ is used to design, model, and verify concurrent systems. TLA+ allows a user to describe a system formally with simple, precise mathematics. TLA+ was designed by Leslie Lamport, a computer scientist and Turing…
Computer Vision with Peter Kontschieder
Nov 8, 2018 • 61 min
Mapillary is a company that processes high volumes of images to develop a labeled 3-D model of the physical world. Mapillary’s APIs allow developers to build applications that are aware of stop signs, buildings, streets, trees, and other physical objects…
Computer Architecture with Dave Patterson
Nov 7, 2018 • 51 min
An instruction set defines a low level programming language for moving information throughout a computer. In the early 1970’s, the prevalent instruction set language used a large vocabulary of different instructions. One justification for a large…
OSS Capital with Joseph Jacks
Nov 6, 2018 • 63 min
Open source projects benefit from the network effects of a large audience of developers. A popular open source project will be contributed to and used by thousands of developers, who are continuously testing, deploying, and improving the software. The…
Commons Clause with Kevin Wang
Nov 5, 2018 • 63 min
Open source software powers everything we do on the Internet. Google runs on Linux servers. Content sites are served by WordPress. Our data is queued in Kafka clusters and stored in MongoDB instances. The success of an open source project often leads to…
Scaling Lyft with Matt Klein
Nov 2, 2018 • 57 min
Matt Klein has worked for three rapidly growing Internet companies. At AWS, he worked on EC2, the compute-as-a-service product that powers a large percentage of the Internet. At Twitter, he helped scale the infrastructure in the chaotic days before…
Wonolo: Staffing Marketplace with Jeremy Burton
Nov 1, 2018 • 56 min
Online labor marketplaces are widely used for one-to-one transactions. On Uber, a rider hires a driver for transportation. On TaskRabbit, a homeowner hires a cleaner to come clean their kitchen. These types of marketplaces are not as widely used for…
Diffbot: Knowledge Graph API with Mike Tung
Oct 31, 2018 • 57 min
Google Search allows humans to find and access information across the web. A human enters an unstructured query into the search box, the search engine provides several links as a result, and the human clicks on one of those links. That link brings up a…
Drift: Sales Bot Engineering with David Cancel
Oct 30, 2018 • 60 min
David Cancel has started five companies, most recently Drift. Drift is a conversational marketing and sales platform. David has a depth of engineering skills and a breadth of business experience that make him an amazing source of knowledge. In today’s…
Building a Hiring Process with Ammon Bartram
Oct 29, 2018 • 54 min
Engineers who start companies often find themselves building something they have no experience with: a hiring process. Hiring engineers today is not as systematic as building software. We don’t have lots of data that tells us what makes for an effective…
Gig Economy
Oct 28, 2018 • 53 min
I like to write music, and a year ago I started working on an album called “Gig Economy”. The plan for the album was to hire musicians from gig economy platforms like Fiverr and Upwork to perform on songs that I produced. The album is finished and I’m…
Blockchain Distribution Network with Aleksandar Kuzmanovic
Oct 26, 2018 • 78 min
Cryptocurrencies are not very usable today. The main use cases for cryptocurrencies today are store of value (somewhat like gold) and speculation. One reason that the use cases are so narrow is the problem of scalability. Cryptocurrencies have several…
Flogo: Event-Driven Ecosystem with Leon Stigter and Matt Ellis
Oct 25, 2018 • 52 min
A smart security camera takes in a high volume of video images and processes those images using a set of machine learning models. Those models can be used to identify interesting snippets of movement throughout the day, and decide which of those snippets…
JAM Stack with Phil Hawksworth
Oct 24, 2018 • 56 min
Engineers can build applications faster by using tools that abstract away infrastructure. Major cloud providers offer this tooling in the form of functions-as-a-service, as well as managed services such as Google BigQuery or Azure Container Instances. The…
DevSecOps with Edward Thomson
Oct 23, 2018 • 55 min
DevSecOps emphasizes moving security out of a siloed audit process and distributing security practices throughout the software supply chain. In the past, software development usually followed a waterfall development process. Each step in building software…
Google JavaScript with Malte Ubl
Oct 22, 2018 • 65 min
Google Search is a highly interactive JavaScript application. As you enter a query, results are being automatically suggested to you before you even finish typing. When you press enter, some of your search results may be widgets that represent the…
AWS Containers with Deepak Singh
Oct 19, 2018 • 52 min
Deepak Singh is the director of compute services at AWS, where he works on cloud products relating to containers, Linux, and High Performance Computing. In today’s show, Deepak describes how the market for containers and serverless has evolved, and how…
Open Source Product Strategy with Shaun Connolly
Oct 18, 2018 • 63 min
Linux has created much more value for Google than it has for Linus Torvalds. Ruby on Rails has created more value for Airbnb than it has for David Heinemeier Hansson. Successful open source projects create more value than their creators’ capture–and…
Cloud Search with Liam Cavanagh
Oct 17, 2018 • 51 min
Search is part of almost every application. Users search for movies to watch. Engineers search through terabytes of log messages to find exceptions. Drivers search through maps to find a destination. Search remains an unsolved problem, with lots of room…
Open vSwitch: Virtual Networking with Ben Pfaff
Oct 16, 2018 • 43 min
Virtual machines are operating system instances that run alongside each other on the same physical host. The virtual machines running on a physical host are managed by a hypervisor running on the physical host. A cluster of two physical servers could have…
Data Warehouse with Christian Kleinerman
Oct 15, 2018 • 63 min
A data warehouse provides fast access to large data sets for analytics, data science, and dashboards. A data warehouse differs from a transactional database, because you often do not need to update specific records. Because of the read-only nature of the…
DevOps at Microsoft with Martin Woodward
Oct 12, 2018 • 64 min
The Windows operating system is one of the most widely used pieces of software in history. Windows was started before there was any alternative to a monolithic codebase, because Microsoft was building software before the Internet was widely used by…
Generative Models with Doug Eck
Oct 11, 2018 • 68 min
Google Brain is an engineering team focused on deep learning research and applications. One growing area of interest within Google Brain is that of generative models. A generative model uses neural networks and a large data set to create new data similar…
Mapillary: Computer Vision Crowdsourcing with Peter Neubauer
Oct 10, 2018 • 67 min
Mapillary is a platform for gathering photos taken by smartphones and using that data to build a 3D model of the world. Mapillary’s model of the world includes labeled objects such as traffic signs, trees, humans, and buildings. This 3D model can be…
Digital Privacy with Aran Khanna
Oct 9, 2018 • 62 min
When Aran Khanna was a college student, he accepted an internship to work at Facebook. Even before his internship started, he started playing around with Facebook’s APIs and applications. Aran built a Chrome extension called Marauder’s Map, which used…
Airbnb Engineering with Surabhi Gupta
Oct 8, 2018 • 51 min
Airbnb began in 2008 as a monolithic Rails application serving the simple purpose of listing homes for rental. Over time, the number of listings increased dramatically, as did the number of people who were renting. With that scale, the Rails app had to be…
Monolith Migration with Jan Schiffman and Sherman Wood
Oct 6, 2018 • 50 min
We previously released this episode with the wrong audio file and are re-releasing it on a weekend. TIBCO was started in the 90’s with a popular message bus product that was widely used by finance companies, logistics providers, and other systems with…
Scalyr: Column-Oriented Log Management with Steve Newman
Oct 5, 2018 • 59 min
Log messages are fast, high volume, unstructured data. Logs are often the source of metrics, alerts, and dashboards, so these critical systems are downstream from a log management system. A log management system needs to be highly available, so that a…
Database Performance and Optimization with Andrew Davidson
Oct 4, 2018 • 66 min
When a database gets large, it can start to perform poorly. This can manifest in slow query speed. You can speed up a query by defining an index, which is a data structure that allows for faster access to the data that is being indexed. As a consequence,…
Cursor: Data Collaboration with Adam Weinstein
Oct 3, 2018 • 54 min
Linkedin is an organization with thousands of employees. An enterprise of that size starts to develop problems with data collaboration. Data collaboration is the process of sharing and analyzing data with multiple users, such as data scientists, business…
Kotlin Design with Andrey Breslav
Oct 2, 2018 • 48 min
Kotlin is a statically typed programming language that started as a JVM language. It gained popularity because it reduces the amount of boilerplate code required for a typical Java project. Many of the early adopters of Kotlin were building Android apps…