Forem: Marcos Ortiz

Cómo comenzar a trabajar con AWS Graviton: La pregunta del Millón

Marcos Ortiz — Wed, 27 Sep 2023 00:25:04 +0000

El sabado pasado (Septiembre 23, 2023) tuve el placer en el AWS User Group Peru Conf 2023, y tengo que decir que el evento quedó increíble.

El evento demostró que la comunidad de AWS en Perú (y en Latinoamerica en general) está más viva que nunca.

Pero algo que entendí en el evento es que habían varias personas que conocían AWS Graviton, pero no lo usaban en producción; y otras personas no lo conocían en todo sentido.

Esto me dejó un pequeño sinsabor en la boca, pero también me dio a entender de que realmente debemos trabajar más para que más personas de habla hispana conozcan la tecnología y le saquen provecho en sus respectivas organizaciones.

Dos de las preguntas más recurrentes que me encontré cuando conversaba con personas en el evento fueron las mismas:

¿Qué es AWS Graviton?
¿Cómo comienzo a trabajar con Graviton hoy?

En este post lo que pretendo es tratar de responder ambas preguntas de la forma más concisa y simple posible

¿Qué es AWS Graviton?

AWS Graviton es simplemente una familia de procesadores diseñados y desarrollados por Annapurna Labs (que es parte de Amazon Web Services) los cuales están enfocado en brindar la mejor combinación de precio y rendimiento para tus workloads en la nube que deben correr sobre Amazon EC2.

Los procesadores Graviton están basados en la arquitectura de Arm llamadas Neoverse N1 en el caso de Graviton 2, y Neoverse V1 en el caso de Graviton3.

Y si nos preguntamos por qué deberías usar estos procesadores, la respuesta es bastante simple:

Las instancias de EC2 basadas en Graviton pueden costar hasta un 20% menos que sus homólogas que usan la arquitectura x86; incluso pueden llegar hasta un 60% menos en costos en el caso de las C7g que usan Graviton3 y un 60% menos en uso de energia en el caso de las nuevas instancias llamadas C7gd, M7gd y R7gd
Lo otro es que hay muchos servicios dentro de Amazon Web Services que hoy soportan el uso de procesadores Graviton, y al final para el usuario, no habría mucha diferencia en funcionalidades; pero si se podría ver reflejado en los costos de los mismos.

Para brindar un ejemplo concreto: si usamos AWS OpenSearch Service y le decimos use instancias con procesadores Graviton 2 para su nodos master y además usamos los nuevos tipos de volumenes llamados General Purpose SSD 3(gp3) de AWS EBS, los costos podrías verse reducidos dramáticamente.

De hecho, en este post del blog de AWS Cloud Financial Management, Ryan Doty, Dan Alvarez, y Mukesh Kumar demuestran precisamente esta combinación y los resultados fueron sencillamente espectaculares:

Instancias basadas en AWS Graviton

Hoy existen varios tipos de instancias EC2 basados en Graviton2, Graviton3 y Graviton3E (que es la última generación de esta familia de procesadores):

T4g: Estas instancias son a mi entender las ideales para realizar pruebas con Graviton. De hecho, hay una excelente oferta para ellas, debido a que hasta el 31 de diciembre del 2023, AWS te brindará hasta 750 horas gratis por mes.
M7g/M7gd: Estas son usadas para propósitos generales con un balance entre networking, CPU y memoria. Están basadas en Graviton3
C7g, C7gd y C7gn: optimizadas para workloads con el CPU como HPC, decodificacion de video, y aceleracion de inferencia de Machine Learning. Estas instancias usan Graviton3 y Graviton3E
R7g, R7gd: Estas instacias están optimizadas para workloads donde la memoria es más importante. Un buen ejemplo de ello es el uso del servicio AWS ElastiCache para Redis con este nuevo tipo de instancia

¿Cómo comienzo a trabajar con Graviton hoy?

Entonces la pregunta del millón: ¿Cómo podemos comenzar a trabajar con Graviton hoy?

Si fuera a compatirle algunos tips, serían éstos:

Revisa primero la guia de cómo comenzar con AWS Graviton disponible en Github. El equipo de AWS ha hecho un increíble en recopilar en un solo lugar muy buenos recursos, así que sería prudente revisarla antes de comenzar a trabajar con ello
Indaga en tu empresa cuáles son los servicios que están usando hoy, y verifica si alguno de ellos ya tiene soporte para Graviton en el programa llamado Graviton Fast Start.
Usa el servicio llamado Porting Advisor for Graviton para verificar algunas librerías que no son compatibles si vas a migrar tu codigo a Arm. Es muy fácil de usar y te aseguro que te podría ahorrar muchos dolores de cabeza
OJO: no hagas una migración en caliente. Primero prueba tu código en una pequeña instancia y ve de a poco
Si usas Docker, una buena práctica es usar el Docker manifest para crear imágenes que sean multi-arquitectura para que soporte tanto x86 como arm64

Y por último quisiera dejarlo algunos de mis recursos favoritos relacionados con Graviton y servicios gestionados por AWS:

Conclusiones

Comenzar a trabajar con AWS Graviton pudiera ser más simple de lo que parece. Sólo es cuestión de comenzar a realizar las pruebas correspondientes, aprender en el proceso y no sólo ahorrar plata sino también tener workloads más eficientes en la nube de Amazon.
Si tienen algún comentario, pregunta, no duden en escribirme a marcos at awsgravitonweekly.com

AWS Graviton Weekly # 23: Week from February 3rd, 2023 to February 10th, 2023

Marcos Ortiz — Sat, 11 Feb 2023 07:10:50 +0000

You're receiving this because you subscribed here OR here

Read the browser version right here

Hey Reader

Welcome to Issue # 23 of AWS Graviton Weekly, which will be focused on sharing everything that happened in the past week related to AWS Silicon: from February 3rd, 2023 to February 10th, 2023.

Today, I'm getting a new picture for the background of this newsletter with my new AWS Community Builder cap.

The AWS Community Management team sent me this package two months ago, but I've not used the cap a lot; only the incredible metal cup.

That changed today when my lovely wife reminded me that I already had a cap and my AWS Graviton Weekly t-shirt as well.

👌👌👌👌👌👌

BTW: welcome to the new subscribers this week.

One of those subscribers asked me a very interesting question:

What are some of the pain points that companies are facing today when they are trying to make the move to Graviton or Arm64 architecture in general?

Love to hear more from you, Graviton community.

The resources you can't miss this week? The post about Sustainability on the Cloud, the workshop about DocumentDB, and perhaps these Tweets???

// Detect dark theme var iframe = document.getElementById('tweet-1622873760125657088-947'); if (document.body.className.includes('dark-theme')) { iframe.src = "https://platform.twitter.com/embed/Tweet.html?id=1622873760125657088&theme=dark" }

// Detect dark theme var iframe = document.getElementById('tweet-1621772507119247360-491'); if (document.body.className.includes('dark-theme')) { iframe.src = "https://platform.twitter.com/embed/Tweet.html?id=1621772507119247360&theme=dark" }

Anyways: Enjoy the content of this week inside the Graviton universe.

Brought to you by Interesting Data Gigs, the Newsletter with Out-of-The-Box Ideas to get a job in Data Analytics

Interesting Data Gigs is my Newsletter + Talent Collective + Jobs Board combo.

If you are looking for a new role focused on Data, subscribe to it and get some ideas on how to get a role in Data Analytics ASAP.

Join 2110+ Data Gigs there

NEWS

Amazon EC2 R6gd instances now available in AWS Region Europe (London)

Starting today, Amazon Elastic Compute Cloud (Amazon EC2) R6gd instances are available in AWS Region Europe (London). These instances are powered by AWS Graviton2 processors, and they are built on AWS Nitro System.

The Nitro System is a collection of AWS designed hardware and software innovations that enables the delivery of efficient, flexible, and secure cloud services with isolated multi-tenancy, private networking, and fast local storage. R6gd instances provide local SSD storage and are ideal for memory-intensive workloads such as open-source databases, in-memory caches, and real time big data analytics that need access to high-speed, low latency storage.
Amazon EC2 R6gd instances offer up to 25 Gbps of network bandwidth, up to 19 Gbps of bandwidth to the Amazon Elastic Block Store (Amazon EBS), and up to 3.8 TB of NVMe-based SSD storage.

Learn more here:
https://aws.amazon.com/about-aws/whats-new/2023/02/amazon-ec2-r6gd-instances-aws-region-europe-london/
https://aws.amazon.com/ec2/instance-types/r6g/
https://aws.amazon.com/ec2/nitro/
https://aws.amazon.com/ebs/

Amazon EC2 C7g metal instances are now available

Starting today, Graviton3-based Amazon Elastic Compute Cloud (Amazon EC2) C7g instances are available in bare metal size.
C7g instances deliver up to 25% better compute performance, up to 2x higher floating-point performance, up to 2x faster cryptographic performance, and up to 3x faster CPU-based machine learning (ML) performance compared to AWS Graviton2 processors, including support for bfloat16.
C7g instances feature the latest DDR5 memory, which provides 50% more memory bandwidth compared to DDR4.

They are built on the AWS Nitro System, a collection of AWS designed hardware and software innovations that enables the delivery of efficient, flexible, and secure cloud services with isolated multi-tenancy, private networking, and fast local storage.
C7g instances are built for workloads including batch processing, ad serving, video encoding, gaming, scientific modelling, data analytics, and CPU-based artificial intelligence and machine learning (AI/ML) inference.

Learn more here:
https://aws.amazon.com/about-aws/whats-new/2023/02/amazon-ec2-c7g-metal-instances-available/
https://aws.amazon.com/ec2/instance-types/c7g/
https://aws.amazon.com/ec2/nitro/

Amazon EC2 High Memory instances are now available in South America (Sao Paulo) region

Starting today, Amazon EC2 High Memory instances with 12TiB (u-12tb1.112xlarge) of memory are now available in South America (Sao Paulo) region.
Customers can start using these new High Memory instances with On Demand and Savings Plan purchase options.
Amazon EC2 High Memory instances are certified by SAP for running Business Suite on HANA, SAP S/4HANA, Data Mart Solutions on HANA, Business Warehouse on HANA, and SAP BW/4HANA in production environments.

Learn more here:
https://aws.amazon.com/about-aws/whats-new/2023/02/amazon-ec2-high-memory-instances-south-america-sao-paulo-region/
https://aws.amazon.com/ec2/instance-types/high-memory/
https://www.sap.com/dmc/exp/2014-09-02-hana-hardware/enEN/#/solutions?filters=v:deCertified;ve:23
https://docs.aws.amazon.com/sap/latest/sap-hana/migrating-hana-to-hm.html
https://aws.amazon.com/blogs/awsforsap/amazon-ec2-high-memory-instances-now-available-for-on-demand-usage/

[Amazon EC2 Mac instances now support replacing root volumes for quick instance restoration](https://aws.amazon.com/about-aws/whats-new/2023/02/amazon-ec2-mac-instances-root-volumes-quick-instance-restoration/?utm_source=awsgravitonweekly)**

Amazon EC2 now supports replacing the root volume on a running EC2 Mac instance, enabling you to restore the root volume of an EC2 Mac instance to its initial launch state or to a specific snapshot, without requiring you to stop or terminate the instance. You can now reset the EC2 Mac instance back to a known state, while still retaining any local data, networking configurations, and IAM instance profiles. You can also leverage this capability to quickly provision fresh macOS environments on your EC2 Mac Dedicated Hosts without triggering the host scrubbing workflow.

Learn more here:
https://aws.amazon.com/about-aws/whats-new/2023/02/amazon-ec2-mac-instances-root-volumes-quick-instance-restoration/
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-restoring-volume.html#replace-root
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-mac-instances.html

[Amazon GuardDuty now available in AWS Europe (Spain) Region](https://aws.amazon.com/about-aws/whats-new/2023/02/amazon-guardduty-aws-europe-spain-region/?utm_source=awsgravitonweekly)**

Amazon GuardDuty is now available in the Europe (Spain) Region. You can now continuously monitor and detect security threats in this additional region to help protect your AWS accounts, workloads, and data.
Customers across many industries and geographies use Amazon GuardDuty, including more than 90% of AWS’s 2,000 largest customers. GuardDuty continuously monitors for malicious or unauthorized behavior to help protect your AWS resources, including your AWS accounts, EC2 workloads, access keys, EKS clusters, and data stored in Amazon S3 and Amazon Aurora. GuardDuty can identify unusual or unauthorized activity like crypto-currency mining, access to data stored in S3 from unusual locations, or unauthorized access to Amazon Elastic Kubernetes Service (EKS) clusters. GuardDuty Malware Protection adds file scanning for workloads utilizing Amazon Elastic Block Store (EBS) volumes to detect the presence of malware. GuardDuty continually evolves its techniques to identify indicators of compromise, such as updating machine learning (ML) models, adding new anomaly detections, and growing integrated threat intelligence to identify and prioritize potential threats.

Learn more here:
https://aws.amazon.com/guardduty/
https://aws.amazon.com/blogs/aws/new-for-amazon-guardduty-malware-detection-for-amazon-ebs-volumes/

Articles and Tutorials

Let’s Architect! Architecting for sustainability, by Luca Mezzalira (Principal Solutions Architect at AWS), Federica Ciuffo (Sr. Containers Solutions Architect at AWS), Laura Hyatt (Solutions Architect for AWS Public Sector), Vittorio Denti (Machine Learning Engineer at Amazon) and Zamira Jaupaj (Enterprise Solutions Architect at AWS)

Sustainability is an important topic in the tech industry, as well as society as a whole, and defined as the ability to continue to perform a process or function over an extended period of time without depletion of natural resources or the environment.
One of the key elements to designing a sustainable workload is software architecture. Think about how event-driven architecture can help reduce the load across multiple microservices, leveraging solutions like batching and queues. In these cases, the main traffic is absorbed at the entry-point of a cloud workload and ease inside your system. On top of architecture, think about data patterns, hardware optimizations, multi-environment strategies, and many more aspects of a software development lifecycle that can contribute to your sustainable posture in the Cloud.
The key takeaway: designing with sustainability in mind can help you build an application that is not only durable but also flexible enough to maintain the agility your business requires.
In this edition of Let’s Architect!, we share hands-on activities, case studies, and tips and tricks for making your Cloud applications more sustainable.

Learn more here:
https://sustainability.aboutamazon.com/environment/the-cloud?energyType=true

If you want to check out the entire Let's Architect series:
https://aws.amazon.com/blogs/architecture/tag/lets-architect/

Azul Platform Prime Delivers Superior Performance on AWS Graviton Instances, by John Ceccarelli (Senior Director of Product Management at Azul Systems)

Azul has long been a leader in bringing Java to 64-bit Arm architectures. In the past, we led the effort to get OpenJDK working on Macintosh Atom 64-bit Arm chips and participated in the effort to bring OpenJDK to AWS Graviton 64-bit Arm chips. Now Azul provides superior performance on AWS Graviton 2 and Graviton 3.

How to install Docker and Compose on Amazon Linux 2, by Floating Cloud

Hi there, I am not going to waste you brains on stupid introductions, If you searched for how to install docker compose on Amazon LInux 2, I won’t add a 2000 word intro to fry your brains!
Amazon Linux 2 is nice and simple and small, but some things need extra attention to install. These commands work for both ARM64 Graviton, etc as well as regular AMD64 amazon linux 2. This also includes installing git and screen. Screen allows you to return to where you left off in disconnected ssh sessions.

Slides, Videos and Audio

VIDEO COURSE: Using AWS Graviton as Your Next-Gen Compute Power, by Jon Myer, ex-amazonian, Chief Evangelist at nOps and host of the Jon Myer Podcast. The course is available on CloudAcademy.

AWS Graviton is the next generation of computing power that will take your application to the next level while reducing cost and increasing performance. You’ll be able to identify if you could take advantage of AWS Graviton2 or 3 or need to re-architect your application to support it.

"The Optimized Apache Doris on AWS Graviton GPU" in the Apache Doris Summit 2022, by SelectDB. Be aware: The video is in Chinese.

Vectorized execution is a starred feature of Apache Doris and also the future trend of analytical database.
Thanks to AWS Graviton CPU, Doris's vectorization is better than ever. Relying on parallel processing and high-performance operators, Apache Doris can provide a sub-second level query on massive datasets. Users today began to build data storage architecture based on features of data lake. In this lecture, you will get the basic idea of how to build a data lake with Apache Doris.

Learn more about Apache Doris and SelectDB:
https://doris.apache.org/
https://en.selectdb.com/

Sustainability in Media with AWS, by Andrew Morrow (Senior Solution Architect at AWS) at Cloud Native Media

Andrew Morrow talks about AWS's approach to sustainability and how it can help Media organisations achieve their sustainability goals. He talks about the innovation inside AWS, specifically about Graviton and Inferentia

El Despertar de la Fuerza Cloud. AWS Certified SysOps Administrator: Amazon EC2, by Juan Mestre, Principal Business Development Manager, LATAM - Flexible Compute at AWS on AWS Women Colombia.
The video is in Spanish, and the description as well

El Despertar de la Fuerza Cloud. AWS Certified SysOps Administrator: Amazon EC2 - YouTube

Juan nos estará conversando sobre Amazon Elastic Compute Cloud (Amazon EC2) que proporciona capacidad de computación escalable. El uso de Amazon EC2 elimina ...

youtube.com

Juan nos estará conversando sobre Amazon Elastic Compute Cloud (Amazon EC2) que proporciona capacidad de computación escalable. El uso de Amazon EC2 elimina la necesidad de invertir inicialmente en hardware, de manera que puede desarrollar e implementar aplicaciones en menos tiempo. Al igual que escalar hacia arriba o hacia abajo para controlar los cambios en los requisitos o los picos de popularidad, con lo que se reduce la necesidad de prever el tráfico.

Introduction to Amazon DocumentDB (with MongoDB compatibility) with demos - AWS Virtual Workshop, with Jason Plank (Sr. GTM Specialist at AWS) and Douglas Bonser (Sr. Specialist Solution Architect at AWS).

This talk was very interesting to me because I didn't know that DocumentDB had already support for AWS Graviton processors, and thanks to Jason and Douglas here, I found out that DocumentDB runs on Graviton smoothly.

I found this blog from 2022 about the topic if you are already interested in it.

Learning Objectives:

Objective 1: Receive an introduction to Amazon DocumentDB including why document databases, use cases, difference between Amazon DocumentDB and traditional databases, and the challenges with scaling traditional databases.
Objective 2: Receive an introduction to scaling, pricing, and migration methods of Amazon DocumentDB.
Objective 3: Stay up-to-date on new features that launched in 2022 including Elastic Clusters, Performance Insights, and fast database clothing.

Jobs

- Sr. Manager, Software Dev, Graviton Software at Amazon

And if you are a company looking for new members for your time, you can get access to our Talent Collective here.

There are 24 active candidates ready for interviews:

EVENTS

MEETUP: Windsor AWS User Group Meetup, Feb, 21st, 2023, Invited Speaker: Rohini Gaonkar (Sr. Developer Advocate at AWS)

WEBINAR: Data Science on AWS - Monthly Webinar: Hands-on Learning with Ray.io, PyTorch, TensorFlow, Kubernetes, GPU, Spark, SageMaker, Kubeflow, with Chris Fregly (Principal Developer Advocate for AI and Machine Learning at AWS) and @anbarth (Principal Developer Advocate for AI and Machine Learning at AWS). Date: Monday, February 20, 2023 12:00 PM to 1:00 PM EST

ONLINE EVENT: Disaster Recovery and Business Continuity with AWS, with Abhishek Srivastav (Sr. Solutions Architect at AWS) and Qualen Bradley (Enterprise Account Executive at AWS)

Join us to learn about building a disaster recovery solution using AWS Elastic Disaster Recovery (AWS DRS). Learn how AWS DRS helps customers minimize downtime and data loss with fast, reliable recovery of on-premises and cloud-based applications using affordable storage, minimal compute, and point-in-time recovery.
The discussion will offer 100–200 level solution and the value of building a disaster recovery solution. At the end, we will play the Kahoot game, and the winners will be awarded an Uber Eats gift card.

Quote of the week

Common questions from customers moving EDA to AWS comes from the change of static to dynamic resources:

How to optimize job execution times?
This graph shows next generation Nitro and graviton chips verification (DV, Formal, Emulation, CV) tasks’ dynamic compute resources for 30 days spanning end of December and start of new year. It represents 5 of every 6 servers in our environment (1/6 are static hosts).
The big spikes are usually in weekends for running all regressions then all results are ready for debug and development beginning of the week. We can see that in the holidays (Christmas/Hanuka) and end of year - there were less on-demand spikes.
Scaling on demand means shorter queue times, instances provisioned instantly and engineering time is not wasted.

But there are best practices to follow:

Always request more than 1 instance type for your job, in case this instance type is in short supply, you’ll still be able to run the job.

Since frontend jobs tend to require smaller RAM

keep the instances small/medium, and limit the number of jobs per instance to shutdown idle instances when jobs complete. Using these customers optimize their costs.

Adi Habusha (Senior Principal Engineer, AWS Graviton Processors Chief Architect at Amazon) Source: LinkedIn

AWS Graviton Weekly # 14: December 2nd, 2022 to December 9th, 2022

Marcos Ortiz — Fri, 09 Dec 2022 15:34:21 +0000

You're receiving this because you subscribed here OR here

Read the browser version right here

Welcome to Issue # 14 of AWS Graviton Weekly, which will be focused on sharing everything that happened in the past week related to AWS Graviton: from December 2nd, 2022 to December 9th, 2022.

In the last issue, I shared some talks from AWS re:Invent 2022 related to Graviton and the AWS Silicon ecosystem, but many of the talks were not available yet in YouTube.

So, in this issue, I will provide an update to those, and I will let the summary of Peter DeSantis's keynote.

Still the same recommendation: Subscribe to the AWS Events YouTube channel and click in the bell to get notified every time they upload a new video.

Enjoy the content of this week. It's a lot, so take your notes.

News

NAB announces long-term cloud deal with AWS

NAB has also recently optimised costs for its cloud-based infrastructure. Using AWS services and products, including AWS Graviton, NAB implemented a program to save over $1 million per month in cloud costs, promoting a company culture focused on both efficiency and innovation for customers.

New Fortinet service offers next-gen firewall protection for AWS environments

Benefits include regionwide network protection at optimized costs, with FortiGate CNF designed to aggregate security across cloud networks, availability zones and virtual private clouds in a cloud region. FortiGate CNF natively supports AWS to optimize cloud security spending and uses AWS Graviton instances to deliver better price-performance than other offerings.

AWS launches Graviton3E, its new Arm-based chip for HPC workloads

At its traditional evening keynote at re:Invent, AWS tonight announced quite a bit of new hardware in its cloud, starting with a new version of its Nitro hypervisor, new instance types and a new version of its custom Arm-based Graviton chips, which was specifically designed for powering high-performance computing workloads. This new Graviton3E chip — a variant of the existing Graviton line — promises significant performance improvements, including 35% better performance for workloads that heavily depend on vector instructions.
These new chips will obviously power new AWS EC2 instance types, starting with the logically dubbed Hpc7G. This new instance type will come in a variety of sizes, with up to 64 vCPUs and 128 GiB of memory. It’ll take until early 2023 before these instances become available, though. For more network-intensive workloads, AWS is also launching a new Graviton3E instance type (c7gn).

AWS Makes Economic Case for Graviton Processors

Amazon Web Services (AWS) is making available in preview a C7gn instance on the Amazon Elastic Compute Cloud (Amazon EC2) based on AWS Graviton processors. The C7gn instances provide up to 200 Gbps network bandwidth and as much as 50% higher packet-processing performance compared to previous-generation C6gn instances.

Product update: Arm Development Studio 2022.2 now available

Arm has released the latest update to Arm Development Studio, with the 2022.2 Gold, Silver, and Bronze editions. The 2022.c Platinum Edition will follow soon after for users with access to that edition.

Articles and Tutorials

Let’s Architect! Optimizing the cost of your architecture, by Luca Mezzalira (Principal Serverless Specialist Solutions Architect at Amazon Web Services), Laura Hyatt (Solutions Architect II at Amazon Web Services (AWS)), Vittorio Denti (Machine Learning Engineer at Amazon), Zamira Jaupaj (Enterprise Solutions Architect at Amazon Web Services (AWS)), Ben Moses (AWS Senior Solutions Architect), and Michael Holtby (AWS Senior Manager Solutions Architecture)

Optimizing Trino using EC2 Spot instances with Zillow by Santhosh Venkatraman (Software Engineer at Zillow) and Rupesh Kumar Perugu (Software Engineer at Zillow)

In this installment of the Trino Summit 2022 sessions, we jump into an exciting topic by folks from Zillow about running Trino on spot instances. Spot instances are cheap and ephemeral nodes that lead to reduced overall compute costs. Spot instances are cheaper as they are not guaranteed to remain available. In this session, Zillow engineers talk about how they use Trino on spots to take advantage of the cost savings while handling the transitory nature of spots.

If you prefer the video, you can watch the talk here

How to Save 73% or More on Inference Costs, by Abhi Gupta (Senior Product Analyst at OctoML)

In machine learning, inferencing accounts. for 90% of AI/ML cloud spend. But there are ways to cut down on the cost of models running in production without impacting latency which degrades user experience. The OctoML team ran an analysis of three popular computer vision and NLP models, against two different CPU-based cloud hardware targets using the OctoML platform. OctoML achieved cost savings and speedups on all three models on both hardware types, but saw huge gains on AWS's Graviton3 powered instances.

VxWorks on Graviton2: Setting up a VxWorks instance in AWS

Optimizing for sustainability, by Liz Fong-Jones (Field CTO at honeycomb.io) in the keynote for DDD Brisbane 2022:

Slides from my keynote at DDD Brisbane on sustainability of IT and adoption of ARM64/Graviton! Your company can make a difference and reduce its environmental impact through a little bit of engineering effort!

Here are all the announcements from re:Invent 2022 related to AWS Silicon

Peter DeSantis's keynote
First, you need to watch the keynote from Peter DeSantis (Senior Vice President of AWS Utility Computing).

Why? Because he shared some incredible stuff there related to AWS Silicon:

First, he announced the new generation of AWS Nitro v5 (link to the exact moment in the YouTube video), which is a massive jump in performance from the previous generation: 2x transistors, 50% faster DRAM speed and a PCIe adapter that provides about twice the bandwith. What this means exactly? This new card is able to support 60% higher packet per second rate with a 30% reduction in packet latency and with 40% better performance per watt.

Then, he continued with the announcement of a new instance type called C7gn, a new network optimized EC2 instance, which is the first instance based in the Nitro v5 system and Graviton. The specs are simply insane: 200 Gbps per second of networking bandwitdth and up to 50% better packet processing performance (compared to C6gn instances). If you want to know more details, I encourage you to read this post from Jeff Barr here.

After that, he shared a very interesting number about Graviton3 based instances: they use up to 60% better performance per watt vs comparable x86 instances while providing 25% better performance compared to Graviton2 instances. Very cool, right?

And then, he shared the coolest stuff of the night: AWS built a new Graviton chip called Graviton3E, a variant of the Graviton3 processor but it's specifically optimized to do more floating points and vector math, which is perfect for HPC applications. Compared to Graviton3 based instances, it does 35% higher performance on HPL (a computational benchmark for lineal algebra), 12% on Gromacs and 30% better on common financial options models

To go even further, he announced another new instance called HPC7g, the lastest generation of EC2 instance for compute-intensive HPC workloads, powered by Graviton3E.

Then, he talked slightly about the AWS Trn1 instances, which is powered by up to 16 AWS Trainium accelerators purpose built to accelerate DL training, 512 GB of memory and 800 Gbps of networking bandwidth.

Another exciting stuff from his keynote was the announcement of AWS Lambda SnapStart, a new capability from Lambda to drastically reduce the cold start latency at no extra cost. To know more about it, you can watch this video about the topic

There are more cool and exciting stuff in the video. So, feel free to watch it entirely. You will love it.

Now, I will share all the sessions related to AWS Graviton, and below of every session, you will see a short description about it. Feel free to pick your favorite ones, grab a cup of coffee and enjoy.

AWS re:Invent 2022 Graviton sessions

ADM201: Ad technology innovation with NBCUniversal and FreeWheel, by Ryan McConville (EVP, Ad Platforms at NBCUniversal Media), Jeff Pinard (SVP & CIO, AdSales and Advanced Advertising, Product & Engineering at NBCUniversal Media), Xinyu Huang (Vice President of Data at FreeWheel) and Stephanie Layser(WW Head, Publisher Ad Tech Solutions @ AWS)

In this session, intended for ad technology, product, and engineering leaders, hear how one of the largest media companies in the world used AWS to reinvent their TV and video advertising workloads. Learn how NBCUniversal built a first-party data platform in the AWS Cloud to create unique audiences and expand addressability and developed privacy-enhanced solutions to collaborate with partners more effectively. Then see how FreeWheel, a Comcast company, improved performance for data and analytics workloads running at massive scale using AWS Graviton–based instances and other cloud capabilities. Learn about best practices, architectures, and lessons learned building scaled publisher-side ad technology workloads.

ADM302: Running high-throughput, real-time ad platforms in the cloud, by Victor Gershkovich (DevOps Team Lead at AppsFlyer), Gerry Louw (Head of WW Solutions Architecture - Advertising and Marketing at Amazon Web Services (AWS)) and Akhil Aendapally (WW Senior Solutions Architect - Advertising and Marketing at AWS)

In this session, designed for technology and engineering leaders, explore best practices and learnings from industry users for how AWS can reduce costs and improve performance for scaled real-time advertising workloads. Learn how AppsFlyer moved their real-time platform that handles more than 800 billion events per day into a scalable, cloud-native architecture using Amazon EKS and AWS Graviton-based instances to improve cost performance and reduce their carbon footprint. Then, hear AWS ad technology experts share customer stories and pitfalls to avoid when running ad platforms at scale.

CMP 201: Silicon innovation at AWS, by Ali Saidi (Sr. Principal Engineer at AWS)

Organizations are bringing diverse workloads onto AWS at a faster rate than ever before. To run diverse workloads with the performance and costs that users expect, AWS often innovates on their behalf and delivers breakthrough innovations even at the silicon level. AWS efforts in silicon design began with the AWS Nitro System but quickly extended to AWS Graviton processors and purpose-built inference chips with AWS Inferentia. In this session, explore the AWS journey into silicon innovation and learn about some of the thought processes, learnings, and results from the experience so far.

CMP 223-L: Compute innovation to enable any application in the cloud, by Dave Brown, (VP of EC2)

AWS offers the most comprehensive set of capabilities and continually innovates across infrastructure and services so you can build, run, and scale applications in the cloud, on premises, and at the edge. Join Dave Brown, VP of Amazon EC2, to hear about the innovations AWS is delivering for millions of organizations. Dave discusses how AWS has developed custom silicon optimized for the cloud and how you can take advantage of AWS compute innovations including processors, machine learning chips, and high-performance storage products.

CMP 301: Powering Amazon EC2: Deep dive on the AWS Nitro system, by Ravi Murty, Senior Principal Engineer, AWS

The AWS Nitro System is a rich collection of building block technologies—including AWS-built hardware offload and security components—that is powering the recent and future generations of Amazon EC2 instances with an ever-broadening selection of compute, storage, memory, and networking options. In this session, dive deep into the Nitro System, review its design and architecture, explore new innovations to the Nitro platform, and see how it has made the seemingly impossible possible.

CMP302: Confidential computing with AWS Compute by Arvind Raghu (Business Development & GTM Strategy, EC2 Core, Nitro Enclaves at AWS) and J.D. Bean (Principal Security Architect - Amazon EC2)

At AWS, confidential computing is defined as the use of specialized hardware and associated firmware to protect in-use customer code and data from unauthorized access. In this session, dive into the hardware- and software-based solutions that AWS delivers to provide a secure environment for customer organizations, with confidential compute capabilities such as the AWS Nitro System and AWS Nitro Enclaves. Additionally, learn about the building blocks for AWS Nitro Enclaves, including tooling, SDKs, attestation, and topics such as CI/CD.

[NOT AVAILABLE YET] CMP303: Get hands-on with AWS Graviton-based EC2 instances, by Arthur Petitpierre (EC2 & Graviton Principal Specialist SA, AWS) and Seth Fox ( Sr. Manager Solutions Architecture, AWS)

AWS Graviton processors are designed to deliver the best price performance for a wide variety of workloads in Amazon EC2. In this workshop, walk through moving a workload to AWS Graviton-based instances, including containerized applications. This workshop is great for developers or IT practitioners who are running Linux-based workloads in Amazon EC2 and are looking for better price performance. You must bring your laptop to participate.

[NOT AVAILABLE YET] CMP309: AWS Graviton adoption by Honeycomb.io using Amazon EC2 and AWS Lambda, by Sunil Ramachandra (Sr.Solutions Architect at AWS) and Pierre Tessier (Director of Solution Architects at Honeycomb.io)

CMP320: Accelerating semiconductor design, simulation, and verification, by David Pellerin (Head of Worldwide Business Development for Infotech/Semiconductor, Amazon Web Services), Mark Galbraith (VP Productivity Engineering at ARM) and William Cornwell (Vice President at Marvell Technology)

AWS offers many solutions to design, simulate, and verify the advanced semiconductor devices that are the foundation of modern technology. Electronic design automation (EDA) workloads are critical to the success of chip development. EDA requires computing for digital and analog simulations, logic synthesis, design rule checks, and physical verification. In this session, discover best practices for running HPC or EDA workloads on AWS using Amazon EC2. Hear from Arm about how they use AWS to accelerate EDA workloads in the cloud using Arm-based AWS Graviton instances. Also, Marvell shares how they’re using EDA in the cloud to scale their highly differentiated cloud-optimized silicon solutions for customers like AWS.

CMP325: Coding for multiple CPU architectures using lessons learned in HPC, by Arthur Petitpierre (EC2 & Graviton Principal Specialist SA, AWS) and Karthik Raman (HPC Application Engineer, Amazon)

This chalk talk details best practices and lessons learned about coding for multiple architectures (x86 and AWS Graviton) from the last ten years in the high performance computing (HPC) community. Amazon EC2 has seen a significant rise in the adoption of Arm-based AWS Graviton instances. When supporting multiple architectures, it’s important to ensure a consistent developer experience. When workloads run on multiple architectures, platform nuances and commonalities must be addressed to forge a transparent developer environment. Come learn how HPC development techniques can be applied to almost any compute workload and how to effectively code for multiple compute infrastructure architectures.

CMP 327: AWS Graviton deep dive: The best price performance for AWS workloads, by Sudhir Ramat (Senior Manager, EC2 Core Compute at AWS) and Oran Barak (Head Of Core Compute Engineering at Stripe):

From many major instance families in Amazon EC2 to managed services such as AWS Lambda, Amazon Aurora, and Amazon EKS, AWS Graviton-based instances are used by tens of thousands of customers to get significant price-performance benefits for a wide variety of workloads on AWS. AWS Graviton3 processors provide up to 25 percent better performance over AWS Graviton2 processors, which already provided significant price-performance benefits. This session dives deep into AWS Graviton3 processors, including suitable workloads and considerations for adoption, and it features an AWS customer speaking about their processor adoption experience.

The most interesting stats of this session? For Trino (SQL Engine), Stripe reduced their average latency by over 50% and reduced their overall error rate.

[NOT AVAILABLE YET] CMP 408: Running containerized workloads on AWS Graviton–based instances, by Seth Fox ( Sr. Manager Solutions Architecture, AWS) and Michael Fischer (Principal Specialist SA, AWS)

Containers are the easiest way to take advantage of AWS Graviton’s unparalleled price performance. In this chalk talk, learn how to build, test, and deploy containers for AWS Graviton using a multi-architecture approach that allows you the maximum flexibility to deploy anywhere on AWS with Amazon ECS, Amazon EKS, and AWS Fargate. The talk also provides techniques to help you migrate your existing containers to AWS Graviton.

[NOT AVAILABLE YET] CMP409: Enhancing OS and application security on AWS Graviton–based instances, by William Koplitz (Senior Specialist Solutions Architect - Graviton, AWS) and Arthur Petitpierre (EC2 & Graviton Principal Specialist SA, AWS)

AWS Graviton processors feature key capabilities that enable you to run cloud-native applications securely and at scale. AWS Graviton3 processors feature always-on memory encryption, dedicated caches for every vCPU, and support for pointer authentication. In this chalk talk, dive deep into how developers can build secure applications using pointer authentication.

PRT220: How to maximize HPC productivity, performance, and portability , by John Linford (Technical Product Manager CPU Software, NVIDIA)

In this session, learn how NVIDIA enables high-performance computing (HPC) on over 200 Amazon EC2 instance types. NVIDIA provides a multi-platform, standards-compliant, vendor-supported solution for HPC application development that supports all major programming models. Its proven compilers, libraries, and software tools support AWS Graviton to maximize developer productivity, enable hardware platform choice, and facilitate an optimal price-performance solution for HPC applications in the cloud.

PRT246: Building real-time applications to utilize AWS Graviton by Tal Gabay ( Engineering Manager, Wix.com), Raj Pai (Vice President, AWS), Subbu Iyer (President and CEO, Aerospike), and Kyle Bush( VP, Data Analytics Architecture, Fidelity Investments)

With the growth of real-time data surpassing every other category, application architects are looking into more efficient infrastructure and real-time data platforms on which to build new real-time applications. AWS Graviton with Aerospike Database provides an ideal starting point to build these next-generation services. In this session, Aerospike CEO Subbu Iyer discusses how to design real-time applications using the smallest cluster footprint and native support for Graviton. Subbu also reviews case studies from Fidelity Investments and Wix.com to illustrate real-time application design on AWS.

DOP315: Sustainability in the cloud with Rust and AWS Graviton with Emil Lerch (Principal DevOps Specialist at AWS) and Esteban Kuber (Principal Software Engineer at AWS)

AWS is focused on efficiency and innovation across its global infrastructure, and that focus highlights how the decisions developers make can have an impact on energy consumption and green initiatives. In this session, learn about the benefits of Rust and AWS Graviton that can reduce energy consumption and increase productivity.

XNT401: Boosting .NET application performance with Arm64 and AWS Graviton3, by Sreelaxmi Pai (Sr. Modernization Architect, AWS) and Kirk Davis (Principal Solutions Architect, AWS)

Did you know you can achieve 40 percent or higher price performance for your .NET 6+ applications using Arm64 and AWS Graviton3 processors? This session dives into the details on how to compile ASP.NET Core for Arm64 and deploy to Graviton3. Learn how to automate the deployment process with an Arm64-based CI/CD pipeline and benchmark a sample application on both Graviton3 and x86 instances to illustrate the benefits. Also, explore strategies such as threading approaches versus those used in x86-based instances and other optimization techniques that you can use to optimize your .NET 6+ applications on Graviton3.

PRT224: Overcoming migration hurdles with CircleCI and AWS Graviton, by Charity Majors (CTO, Honeycomb.io), Tom Trahan ( VP Business Development, CircleCI) and William Koplitz (Senior Specialist Solutions Architect - Graviton, AWS)

Employing intelligent automation throughout the software development workflow is essential to avoiding continually escalating effort and costs as you grow, but not knowing how to do so may be holding you back.
This problem can be daunting, but luckily, with the right solutions that doesn’t have to be the case. Hear from Honeycomb, CircleCI, and AWS Graviton on the biggest obstacles teams face when scaling in the cloud and the DevOps and CI/CD practices companies like Honeycomb and Sweetgreen implemented with CircleCI and AWS Graviton, which led to 50 percent increases in speed and 50 percent decreases in costs.

PRT265: What to know before adopting Arm: Lessons learned at Datadog , by Jason Yee ( Staff Technical Evangelist, Datadog)

Moving from x86-based Amazon EC2 instances to AWS Graviton Arm-based processors can save you a lot of money—up to 40 percent better price performance. But can you just update your AWS CloudFormation templates from T2 to T4g and reap the savings? Datadog runs tens of thousands of nodes and has migrated a significant portion of their workloads to AWS Graviton. In this session, hear the top lessons Datadog has learned to help you prepare for a migration. Find out what changes you may need to make to your applications and how to operate and observe your services to get the most performance from the AWS Graviton architecture.

CON308: Reduce your operational and infrastructure costs with Amazon ECS, by Vibhav Agarwal (Sr PM, AWS Containers) and Francis Pereira (VP, Infrastructure Engineering at CleverTap)

In this session, walk through how to reduce operational overhead from the control plane with Amazon ECS. Learn about how to use containers for bin-packing workloads, efficient scaling techniques, cost savings plans, AWS Copilot, blueprints, and AWS Graviton.

Again: there are a lot of videos that have not being uploaded yet to the channel. So, subscribe here.

Jobs

AWS Engineer (Direct hire) at VIIZR

- Site Reliability Engineer SRE (Direct Hire) at Directus

- Machine Learning Engineering Lead at Conjecture

- Backend Engineer (Founding Team) at Seen [REMOTE]

- Product Engineer at Conjecture

- Full Stack Engineer, Applied Technologies at Enigma (US only)

- Full-Stack Software Engineer at Nourish

- Blockchain Cryptography Dev Researcher at Binance

- Cloud DevOps Engineer (Direct hire) at FCB Chicago

If you are actively looking for a new role, you should join our Talent Collective here. It's completely free to the candidates.

And if you are a company looking for new members for your time, you can get access to our Talent Collective here.

There are 15 active candidates ready for interviews:

This issue was sponsored by ConvertKit and Deel.