Prophecy is a complete Low-Code Data Engineering Platform for the Enterprise. Prophecy enables all your teams on Apache Spark with a unique low-code designer. While you visually build your Dataflows – Prophecy generates high-quality Spark code on Git. Then, you can schedule Spark workflows with Prophecy’s low-code Airflow. Not only that, Prophecy provides end-to-end visibility The post Prophecy: Apple of Data Engineering with Raj Bains appeared first on Software Engineering Daily.

Podcast – Software Engineering Daily

Prophecy: Apple of Data Engineering with Raj Bains

We’ve been running Software Daily for 6 years.  When we started it back in 2015, the goal was to create a software engineering podcast that was 60% as good as Software Engineering Radio, but aired with 5x the frequency.  5 shows per week, 50 weeks per year, 5 ads per show, means 1,250 advertising spots. The post Our Current Strategy appeared first on Software Engineering Daily.

Our Current Strategy

In the previous episode, Pulsar Revisited, we discussed how the company DataStax has added to their product stack Astra Streaming, their cloud-native messaging and event streaming service that’s built on top of Apache Pulsar. We discussed Apache Pulsar and the added features DataStax offers like injecting machine learning into your data streams and viewing real-time The post Pulsar Rerevisted with Enrico Olivelli appeared first on Software Engineering Daily.

Pulsar Rerevisted with Enrico Olivelli

Apache Pulsar is a cloud-native, distributed messaging and streaming platform originally created at Yahoo! and now a top-level Apache Software Foundation project (pulsar.apache.org). Pulsar is used by many large companies like Yahoo!, Verizon media, Tencent, and Splunk. The company DataStax, an open, multi-cloud stack for modern data apps, has added to their product stack Astra The post Pulsar Revisited with Jonathan Ellis appeared first on Software Engineering Daily.

Pulsar Revisited with Jonathan Ellis

If you’ve ever googled a CS or programming question, you likely found an answer (or many) on Stack Overflow. Founded in 2008 and named after a common computing error, Stack Overflow empowers the world to develop technology through collective knowledge. More than 100 million people visit Stack Overflow every month making it one of the The post Stack Overflow for Teams: A Centralized Knowledge Sharing and Collaboration Platform with Tom Limoncelli appeared first on Software Engineering Daily.

Stack Overflow for Teams: A Centralized Knowledge Sharing and Collaboration Platform with Tom Limoncelli

In 2003, Google developed a robust cluster management system called Borg. This enabled them to manage clusters with tens of thousands of machines, moving them away from virtual machines and firmly into container management. Then, in 2014, they open sourced a version of Borg called Kubernetes, or K8s.  Now, in 2021, CockroachDB is a distributed The post CockroachDB: Distributed Databases and Containerization with Spencer Kimball appeared first on Software Engineering Daily.

CockroachDB: Distributed Databases and Containerization with Spencer Kimball

Governments, consumers, and companies across the world are becoming more aware and attentive to the risks and causes of climate change. From recycling to using solar power, people are looking for ways to reduce their carbon footprint. Markets like the financial sector, governments, and consulting are looking for ways to understand climate data to make The post Sust Global: Taking Action Against Climate Change with Josh Gilbert appeared first on Software Engineering Daily.

Sust Global: Taking Action Against Climate Change with Josh Gilbert

Big data analytics is the process of collecting data, processing and cleaning it, then analyzing it with techniques like data mining, predictive analytics, and deep learning. This process requires a suite of tools to operate efficiently. Data analytics can save companies money, drive product development, and give insight into the market and customers. The company The post Imply Infra: Big Data Analysis and Real-World Examples with Jad Naous appeared first on Software Engineering Daily.

Imply Infra: Big Data Analysis and Real-World Examples with Jad Naous

Ashmeet Sidana is the founder of Engineering Capital. The post How to Convince Ashmeet Sidana to Invest in Your Business appeared first on Software Engineering Daily.

How to Convince Ashmeet Sidana to Invest in Your Business

DevOps has shortened the development life cycle for countless applications and is embraced by companies around the world. But managing and monitoring multiple environments is still a major pain point, particularly when companies need to mix cloud and legacy systems. Knowing when services go down and quickly pinpointing the cause is essential for continuous development.  The post Better Stack: A New DevOps Experience with Juraj Masar appeared first on Software Engineering Daily.

Better Stack: A New DevOps Experience with Juraj Masar

Data science is an interdisciplinary field that combines strong technical skills with industry knowledge to perform a large range of jobs. Data scientists solve business questions with hands-on work cleaning and analyzing data, building machine learning models and applying algorithms, and generating dynamic visuals and tools to understand the world from the data it generates. The post Data Science on AWS: Implementing AI and ML Pipelines on AWS with Chris Fregly appeared first on Software Engineering Daily.

Data Science on AWS: Implementing AI and ML Pipelines on AWS with Chris Fregly

In this episode we discuss the new Move Fast book, as well as many aspects of the current state of software engineering. Daliana Liu interviews Jeff Meyerson, host of Software Daily and author of Move Fast. This interview was also recorded as a video podcast. Check out the video on the Software Daily YouTube channel. The post Move Fast with Jeff Meyerson appeared first on Software Engineering Daily.

Move Fast with Jeff Meyerson

Big Data has exploded the past decade as cloud computing and more efficient hardware made scaling essentially limitless. Products like Uber revolve entirely around analyzing data to provide rides. According to an EMC/IDC study, there was approximately 5.2TB of data for every person in 2020. That estimate was made before the transition to remote work, The post Data Lineage: Understanding Data Lineage at Scale with Julien Le Dem appeared first on Software Engineering Daily.

Data Lineage: Understanding Data Lineage at Scale with Julien Le Dem

Here is the full audiobook for “Move Fast: How Facebook Builds Software”. Continue listening to the end to hear my most recent album “Simulation”. The post (Full Audiobook) Move Fast: How Facebook Builds Software appeared first on Software Engineering Daily.

(Full Audiobook) Move Fast: How Facebook Builds Software

We talk to a lot of exciting startups from all over the world about their tech products. Recently we’ve heard from people innovating in the blockchain space, cloud infrastructure, databases, and automation tools. However, in today’s episode, we’re going to talk about how these tech startups get investments to build their great products in the The post Investment Strategy: Defining New Markets with Sarah Guo appeared first on Software Engineering Daily.

hubhopper

Podcast – Software Engineering Daily

hubhopper