DATA Pill #063 - are Kubernetes days numbered? Hugging Face & data streaming in retail

ARTICLES

If you want to improve your progress with Hugging Face LLMs, this one is a must-read for you. It explores the 12 things every beginner should know, split into 4 main topics such as: the training course, transformers and pipelines, what model you should pick and LangChain and Text2Text-generation.

Dig down deep into the 'guts' of Kubernetes to learn more about how it works. Read about Managed Kubernetes, Google’s Container Offerings, compare GKE Standard to Autopilot, Cloud Run and finally decide which you should choose.

How should the new generation of observability tools respond in 2023? Here are seven things we will need to win the market. You're welcome!

Take a look at the realm of data orchestration platforms and compare three contenders: Airflow, Prefect and Kestra. As of 2023, let’s analyze their respective strengths and features, aiming to uncover which platform stands out as the best choice for effectively managing and orchestrating data workflows.

In 2023, the retail industry is evolving with omnichannel experiences, hybrid shopping and hyper-personalized recommendations. Kai explores how data streaming enables real-time integration at scale, driving retail transformation with compelling examples from major players like Walmart and Albertsons.

TUTORIALS

Let’s explore what CockroachDB is and describe how AWS DMS can help migrate data to CockroachDB, and walk through an example migration. Find out more about migrating mission-critical workloads with AWS DMS and migrate to CockroachDB Using AWS DMS.

Another part of the tutorial we shared with you in DATA Pill 47 has landed.

In part one of this series we learned how to use YAML to simplify the configuration of Terraform resources. We mainly focussed on reducing syntax overheads of the HCL language and making the configuration accessible to non-infra engineers. In this second part we will dive into some more advanced techniques and patterns.

Dig into and see how Vodafone achieved significant efficiency gains, improved data quality, flexibility and compliance processes by using their AI Booster. Read more about AI Booster at work and what is predicting churn in two different markets.

DATA LIBRARY

This one really shakes up what we thought about GPT4 and other LLMs. Some Stanford University people, including Matei Zaheria, checked if GPT4 and ChatGPT's performance has been flip-flopping over time. They found some pretty big changes. For example, GPT-4 went from scoring a cool 97.6% to a measly 2.4% between March and June in tasks like figuring out prime numbers. Other tasks saw less dramatic shifts, but there's no doubt the LLM performance is like a roller coaster ride. We're guessing that OpenAI is tweaking things on the regular, but the how and why is still a mystery. A heads up to everyone building stuff with GPT-4, unpredictable LLM behavior is a real headache.

DATA TUBE

In this one, Andrew introduces the concept of Data Contracts and talks about how they at GoCardless are using it to improve the quality and reliability of data by empowering data consumers - including our Data Scientists - to work closely with the data generators and get the data they really need to power highly effective ML models and other data-driven products.

PODCAST

Meet Ola Sars, the visionary music tech guru hailing from Stockholm. As the brain behind Soundtrack Your Brand, he's revolutionized the B2B music streaming landscape with a cloud-based platform that harmonizes licensed tunes, powerful analytics and personalized playlists.

Topics included in this episode:

• The importance of data at Soundtrack Your Brand
• Data-driven use-cases implemented at Soundtrack Your Brand
• Differences between B2B music streaming (e.g. Soundtrack Your Brand) vs. B2C music streaming (e.g. Apple, Spotify)
• If and how data & AI helps in achieving profitability at Soundtrack Your Brand
• Current plans for investing in data & AI at Soundtrack Your Brand
• Generative AI in the B2B music streaming industry

and more.

CONFS EVENTS AND MEETUPS

Join the DeveloperWeek CloudX, where one track is DevOps. In this one, the latest in automated testing, reporting and deployment while exploring and defining best practices for implementing security (DevSecOps), infrastructure as code and organizational change management to reap the full benefits of engineering automation will be discussed.