While the weather in Vegas turned cold and rainy yesterday, the enthusiasm for the conference remained bright.
Werner Vogels, Amazon’s CTO, with the help of his Amazon Alexa, started the day off walking us through his journey from his worst day at AWS to his best.
His worst involved an on-prem database that couldn’t scale to meet their needs. This lead to the creation of Aurora, the fastest growing service in AWS since its release. Leave it to AWS to solve a database problem by building a better database from the ground up. This led to purpose built DBs such as RDS, DynomoDB, Elasticache and Neptune.
His best day, not surprisingly, is the day they moved their largest data warehouse off Oracle to Redshift.
AWS’ scalable and reliable infrastructure were the main themes of these stories. This laid the groundwork for the new announcements centering around serverless. Vogels wants to free customers from having to worry about the underlying infrastructure. His favorite keynote was when he announced Lambda in 2014.
Vogels stated that 95% of AWS features are built based on customer feedback, which lead to the following new announcements:
Amazon Redshift concurrency scaling: An improvement on the existing product that provides consistently fast responses to queries even when there are thousands of concurrent users and queries. This is available for preview today. You can sign up on the Redshift page.
AWS Toolkits for popular IDEs: New toolkits for PyCharm, IntelliJ (Preview), and Visual Studio Code (Preview).
Lambda now supports Ruby: You can now develop your AWS Lambda function code using Ruby.
Lambda Runtime API: Allows you to bring your own language to Lambda. No more language limitations.
Lambda Layers: Provides the ability to store and version commonly-used code for easier reuse. Partners are already providing layers you can use.
Nested Applications Using Serverless Application Repository: This allows you to compose an application from reusable building blocks. New architectures are a set of nested serverless applications.
Step Functions service integrations: This allows you to connect to AWS services without having to write customer code. Currently this supports eight AWS services; Batch, ECS, Fargate, Glue, DynamoDB, SNS, SQS, and SageMaker.
ALB Support for Lambda: Users can now have stateful HTTP access serverless applications. This could allow applications that are server-based to be moved to Lambda functions without affecting the end user.
Amazon Managed Streaming for Kafka: Kafka is an open-sourced data streaming tool and can be hard to manage and set-up. AWS wants to take over this burden for you by providing a managed service.
AWS Well-Architected tool: Well-Architected reviews have been around for some time, and I have conducted a few myself. As you can imagine, AWS and its partners don’t have enough resources to help customers conduct these reviews. Starting today, the automated tools are available for you do this this review yourself.
Sessions and Events
Yesterday was another full day of sessions, including some covering the new announcements from Jassy and Vogels. As my colleague stated yesterday, if you missed a session, you can stream it on-demand later on the AWS re:Invent YouTube channel.
The night wound up with not-to-be-missed AWS re:PLAY with music by Skrillex.
Yesterday was also the final day of the Expo, and we at 2nd Watch hope you got a chance to stop by our booth to say hi. Over the week, we had the pleasure of talking to cloud consumers from all over the world. Regardless of location and industry, we all enjoyed solving technical challenges with AWS services.
Hope everyone had a great time and safe travels!
Larry Cusick – Solutions Architect
Andy Jassy, AWS CEO, delivered Wednesday’s AWS re:Invent keynote with an emphasis on platform differentiation, relative to competitors. In summary, he noted that AWS financials continue to have unpresented growth with a $27B revenue run-rate; 46% YoY growth or $2.1B in absolute revenue, and a 52% market-share or 4x more than the next closest competitor. Staying with the differentiation theme, Jassy noted re:Invent 2018 is the largest attended technical conference with approximately 53,000 attendees and 2,100 technical sessions; the largest public cloud customer footprint, specifically, largest number of cloud-native startups and ISVs, and enterprise customers across all market segments; the largest partner ecosystem, where 2nd Watch was a noteworthy mention.
The keynote’s principle is what Jassy referred to as “The 5 Sentiments of What Builders Want.” Builders being the extensive AWS user community. The sentiments were cleverly revealed in musical covers by the AWS Band, giving Jassy the premise to disclose related new product announcements:
- I Want It All – Queen
Jassy highlights that builders want uncompromised access to the AWS Cloud with appropriate tools to get them there fast and easy. New Data Transfer and Storage Services differentiators that facilitate AWS adoption. Notable product announcements included:
- AWS DataSync – automate movement of data between on-premises storage and Amazon S3 or Amazon EFS
- AWS SecureFTP – fully-managed SFTP service for Amazon S3
- Amazon S3 Batch Operations (Preview) – manage billions of objects stored in Amazon S3, with a single API request or a few clicks in the S3 Management Console
- Amazon S3 Intelligent Tiering – Amazon S3 storage class designed for customers who want to optimize storage costs automatically using ML Auto-Tiering
- Glacier Deep Archive (Jan 2019) – durable object storage for long-term data retention and digital preservation, less than .10 of $0.01/GB/month
- AWS EFS-Infrequent Access – saves up to 85% over EFS, cost-optimized for files that are accessed less frequently
- Amazon FSx for Windows Server – fully-managed, with full support for the SMB protocol and Windows NTFS, Active Directory (AD) integration, and Distributed File System (DFS); PCI, HIPAA, and ISO Compliance built-in
- AWS File System for Lustre – fully managed file system that is optimized for compute-intensive workloads; PCI, HIPAA, and ISO Compliance built-in
- I’ve Been Waiting – Matthew Sweet
Jassy focuses on new AWS Services that allow builders an easier path for the use and adoption of the AWS Cloud Platform, with a focus on automation and compliance. Notable product announcements included:
- AWS Control Tower – automates the setup of a baseline environment, or landing zone, that is a secure, well-architected multi-account AWS environment
- AWS Security Hub – gives you a comprehensive view of your high-priority security alerts and compliance status across AWS accounts
- AWS Lake Formation – set up a secure data lake in days, not weeks
- Blackbird – The Beetles
Freedom is the theme here. With new data patterns, AWS is giving builders the freedom to deprecate legacy database constraints and give them the access to choose “the right tool (DB) for the right job (workload).” Notable product announcements included:
- Amazon DynamoDB On-Demand – on-demand is a flexible new capacity mode for DynamoDB
- Amazon Timestream – purpose-built time series database service for collecting, storing, and processing time-series data (IOT Sensors, Telemetry, etc)
- Amazon Quantum Ledger Database (QLDB) – blockchain use cases, your application’s complete change history is immutable – it cannot be altered or deleted using cryptography
- AWS Managed Blockchain – fully managed service that allows you to set up and manage a scalable blockchain network
- Satisfy Me – Elvis Presley
All about AWS delivering on customer feedback and satisfying the need to enhance the AI and ML services’ user experience with real-world application scenarios. With the launch of AWS Deep Racer (see below), AWS enables a fun, quick, and easy application of ML in the real world. Notable product announcements included:
- AWS Inferentia – a ML inference chip, custom designed by AWS to deliver high throughput, low latency inference performance at an extremely low cost
- Amazon Elastic Inference – allows you to attach just the right amount of GPU-powered acceleration to any Amazon EC2 and Amazon SageMaker instance
- Amazon SageMaker Ground Truth – helps you build highly-accurate training datasets for ML quickly
- Amazon Marketplace for ML – ML models and algorithms for Amazon SageMaker
- Amazon SageMaker Reinforcement Learning (RL) – SageMaker built-in, fully-managed reinforcement learning algorithms
- AWS Deep Racer and Deep Racer League – the fastest way to get rolling with ML, a 1/18th scale race car which gives you an interesting and fun way to get started with reinforcement learning (RL)
- Amazon Textrac – intelligent OCR++, uses ML to instantly “read” virtually any type of document to accurately extract text and data
- Amazon Personalize – ML service that makes it easy for developers to create individualized recommendations for customers using their applications
- Amazon Forecast – fully managed service that uses ML to deliver highly accurate forecasts
- Should I Stay Or Should I Go – The Clash
Extending the AWS Cloud Platform ecosystem to facilitate and entice adoption with new Hybrid Cloud services. Expanding the partnership with VMWare to bring AWS Services on-prem.
- RDS on VMware Cloud – deploy managed databases in on-premises VMware environments using the Amazon RDS
- AWS Outpost – bring native AWS services, infrastructure, and operating models to virtually any data center, co-location space, or on-premises facility. Two flavors:
- VMWare Cloud on AWS Outpost – VMWare Control Plane
- Native AWS Outpost – AWS Control Plane and APIs
- VMware Cloud Foundation for EC2 – a collection of host-resident probes, drivers and agents that allow the vSphere system to optimize and manage workloads running on EC2 environments, either in Amazon’s EC2 public cloud or on premise on Amazon’s Outposts hybrid cloud solution
- Snowball Edge-Compute Optimized – includes a 10GBase-T network connection, 10/25Gb SFP28 and 40Gb QSFP+ copper and optical networking for fast data transfer to the device
It’s apparent AWS is listening and intent on continued enablement of the builder, sharing the tools and technologies that’s made them successful – specifically, their innovation of AI and ML use-cases to enable builders to do what they do best without limits. We saw real-world application of AWS’ enablement from two brief customer presentations:
- Guardian, CIO – Dean Del Vecchio: Cloud First Strategy – Secure & Compliance migrated over 200 applications to AWS, allowing them to reduce DC space by 80%. AWS gives Guardian unprecedented competitive advantage.
- Formula1, Managing Director – Ross Brawne Obe: Using Amazon SageMaker with ML sensors and telemetry in race cars to enhance fan viewership engagement of Formula1 racing, as well HPC for new racecar designs.
Jassy closed with the well-versed FDR quote, “The Only Thing To Fear, Is Fear Itself!” With AWS as market-leader, continuous innovation of the AWS Platform, and a rich Partner Competency and MSP ecosystem, builders small and large are empowered in their adoption and journey to the cloud.
For a full list of AWS re:Invent 2018 product announcements, visit https://aws.amazon.com/about-aws/whats-new/2018/, or for help utilizing any of these products, contact us.
-Burt Giron, Solutions Architect
Day 2 at AWS re:Invent 2018 was busy with its breakout sessions, panels discussions, and training bootcamps. Amidst all of this were a slew of new services and service feature announcements for AWS. Here’s a quick overview.
Private Marketplace: Private Marketplace allows IT administrators to create a pre-approved, authorized list of marketplace offerings that meet corporate guidelines and standards. This controls which marketplace products can be deployed in your cloud environment. It integrates with AWS Organizations and can be customized to include your logo and corporate branding.
New Container Products in AWS Marketplace: More than 180 container products are now available in the AWS Marketplace. These can be consumed straight from the ECS console.
AWS Developer Tools: These tools now provide better support for Continuous Delivery for AWS Fargate and Amazon ECS, allowing support blue/green deployments via AWS CodeDeploy.
AWS Elemental MediaConnect: A new, general availability services launched on Tuesday is AWS Elemental MediaConnect that provides a reliable, secure, flexible transport service for live video.
Broadcasters and content owners can now more easily transmit their content to destinations around the world.
Amazon CloudWatch Logs Insights: A new analytics service for CloudWatch logs, you can now run queries on logs, create a dashboard for log-based metrics, and visualize timeseries data.
Amazon DynamoDB Support for Transactions: DynamoDB now supports ACID (atomicity, consistency, isolation, and durability) transactions allowing a new class of mission-critical workloads to run on DynamoDB.
Amazon Comprehend Medical: A natural language processing service for medical text makes it easier to use machine learning to extract relevant medical information from unstructured text.
Customized Translations for Amazon Translate: A new feature called Custom Terminology allows you to customize Amazon Translate to use your company or domain specific vocabulary.
Java-based Stream Processing for Amazon Kinesis Data Analytics: You can now use Java code to continuously transform and load your data.
Dashboard embedding and APIs for Amazon QuickSight: QuickSight dashboards can now be embedded in your applications.
With all these announcements yesterday, we can’t wait to see what today brings! If you haven’t yet, stop by and visit us in booth #2440 and enter to win an Amazon DeepLens.
-Vince Lo Faso, Solutions Architect
AWS re:Invent 2018 kicked off with the Global Partner Summit Keynote this morning, where many interesting data points about the growth of the global partner ecosystem were shared by Terry Wise, along with a vision of the future from Andy Jassy.
This was the 7th Global partner summit, and given the incredible range of solutions created by AWS partners and the growth of AWS, the summit is now 10 times larger than at its inception, and the partner ecosystem is 30 times larger! AWS has grown 46% since 2017, thousands of new customers have been gained, and this momentum has been driven, to a large degree, by AWS -partners like 2nd Watch.
Strategic partnerships are also key to AWS’ business scale. New AWS instance types with up 12TB of memory are available to support SAP HANA, and AWS is now the #1 location to run SAP, even over on-premises! The VMware Cloud on AWS offering now has the support of over 200 partners, and customer success stories about the ease of migration are racking up. Also, worldwide share of hosting Windows workloads are growing, and AWS hosts 57%, compared to 30% and 11% on Azure and other solutions, respectively.
During this session there was a focus on the AWS marketplace, which has greatly expanded in its role to help connect partners to clients. AWS noted that there are now 950K subscriptions to partner solutions. There have also been 100 new software vendors this year and 300 new product listings. In addition, there is the new AWS Solution space, which features solutions built for featured use cases by AWS Competency Partners like 2nd Watch.
Both Terry Wise and Andy Jassy gave insights into the areas where partners will be critical to success and adoption of AWS in the future. Some of the highlights included:
- AI and ML: Over the next 5 years adoption and integration of these services is set to rapidly expand.
- Serverless: The basic unit of compute is getting smaller, with container services like ECS and EKS growing quickly, as well as management of containers with Fargate expanding. There is also adoption of event driven serverless solutions. This microservice architecture uses smaller components for better performance and lower cost. Also, AWS expanded the AWS Competency Program to include Container Competency for ECS and ECS for Kubernetes designations.
- AWS Connect: Call center services are seeing fast adoption, and the service is enabling a great reduction in call volume.
- Data management: Clients need help with getting data into the cloud, including a proper landing zone with a secure multi account environment. This is a daunting task that clients get paralyzed with and/or don’t implement solutions with guard rails or security services. Partners can help implement data lakes to transform the data and take advantage of the analytics and machine learning capabilities in AWS.
- AWS SaaS Factory: The AWS SaaS Factory program provides a broad range of business and technical enablement resources for building, migrating, and optimizing software-as-a-service (SaaS) on AWS. This allows a secure solution for multi-tenant architectures.
- AR, VR, IoT: These emerging technologies are maturing and ripe for third parties to develop solutions and will soon become mainstream.
Despite these advanced services, the consensus is that the industry is currently into the meat of public cloud adoption. Businesses need help with migration solutions, including portfolio assessment and mass migration. This is expected to expand as the economy grows.
The key takeaway is that partners innovate on behalf of the client and create long term relationships that help clients take advantage of the fast pace of AWS service enhancements. To see how 2nd Watch can do this for you, contact us.
-Eric Deehr – Cloud Solutions Architect
Will you be at AWS re:Invent 2018? 2nd Watch is sponsoring the event, and we want to see you! Stop by booth #2440 to speak with a cloud solutions expert or pre-schedule your meeting with us today.
Plus, pick up your limited-edition 2nd Watch t-shirt – back by popular demand, The Datafather t-shirt! – and enter to win an Amazon DeepLens. And don’t forget about the 2nd Watch After Party! Request your invitation to one of the hottest parties at re:Invent. You’ve worked hard. You deserve a little fun.
Last, 2nd Watch is hiring and will be meeting with top-talent professionals at re:Invent. If you are attending re:Invent and would like to discuss opportunities to join our dynamic team, please contact our team at email@example.com or check out our careers page to see a complete list of open positions
See you in Vegas!
-Nicole Maus, Marketing Manager
The annual AWS re:Invent conference is just around the corner kicking off on November 26th in Las Vegas. Rest assured, there will be lots of AWS-related products, partners, and customer news, not to mention more than a few parties and chances to network with fellow conference-goers. Here are some helpful tips and a few topics we expect to hear about this year.
1. Enterprise Security – Always a hot topic.
As Enterprise cloud adoption continues to grow at an increasing pace, so does the need for strong governance and security offerings. This year we have seen many new releases and enhancements from AWS to beef up its security offerings. Amazon Guard Duty was released at re:Invent 2017, so we may see some new capabilities announced such as improved integration with other new or existing AWS services.
GRC is not just for your old data center anymore. Governance, Risk and Compliance is vital for long-term success of your adoption of the cloud. With the initial release of AWS Compliance Center for Financial Services in early September, we anticipate some updates there as well.
The dynamic nature of the cloud continues to create specific challenges for security. Better security and visibility for ephemeral resources, such as containers, and especially for AWS Lambda, are a particular challenge. We would be extremely surprised if we didn’t see some more announcements in this area.
2. Will CEO Andy Jassy finally bring me the Transit VPC Service I’ve been dreaming of?
For many years we have had the architectural challenge of transitive routing in AWS, and for many years I have sat in attendance at the re:Invent keynote in awe over Andy Jassy and Werner Vogels, hanging on their every last word as they masterfully fire out new product releases like it was some sort of magic show, many of us hoping they would one day announce that they are going to solve this transitive routing challenge with a cloud native AWS service. But alas, each year it has been like opening all your Christmas gifts only to find the one thing you really, really hoped for was nowhere to be found. Will this finally be the year? Will Santa Jassy bring us the easy button for transitive routing? With the recent releases and lots of extensive activity around Transit VPC via CFT in combination with Lambda, tags and Cisco CSR’s, it feels like we’re almost there. Surely they will not let another year pass. My bet is this is the year we see it come to fruition. I will get my most sought-after gift this year. I will get my Atari 2600, my Optimus Prime, my AT-AT Walker. You bet I will! Well, at least I hope.
3. General Releases – ‘nuff said!
Amazon Data Lifecycle Manager was released in July of this year and is a simple way to schedule and manage EBS volume backups without relying on a third-party tool. We expect to see expansion into more regions and are hopeful for more granular snapshot timing options. Currently it only allows scheduled backups to run every 12 or 24 hours.
As has become the norm, we anticipate new instance types and/or families to be announced. Last year we saw M5 and H1 instance types as well as Bare Metal instances (preview) introduced. Per an article by Jeff Barr earlier this year, Bare Metal Instances with 6 TB, 9 TB, 12 TB, and more memory are in the works, all designed specifically for SAP HANA and other in-memory workloads. We wouldn’t be surprised to see some sort focus around this.
4. Parties, let’s get this place rockin’!
2nd Watch will be teaming up with Palo Alto Networks this year to host its annual party at the Omnia Nightclub located in Caesars Palace. There will be great food, an open bar, an awesome DJ, and of course friends from years past. Every year this is a sold out party, so if you’re not yet on the guest list, request your invitation at https://offers.2ndwatch.com/aws-reinvent-2018. We’d love to connect with you, and it’s a party you will not want to miss.
In keeping with a long-running tradition, AWS’ re:Play Party will be off the chain and likely cause some rough flights home the next day. Last year, DJ Snake spun the night away while attendees bounced on mega castles, played games and took advantage of the open bar. Amazon Web Services always pulls out all the stops, and we expect this year they will continue to raise the bar.
2nd Watch Tips & Tricks
Last, we want to offer up some information we think will be beneficial to maximize your time at re:Invent. Here are a few tips & tricks we have learned over the past 6 years (Wow! Has it been that long already?)
- Avoid walkup breakout sessions, unless there is a very short, or no, line. Many people have waited up to 2 hours for a walkup breakout session only to be turned away at the door due to a full house. Have no fear, friends! All of the breakout sessions are recorded and will be posted online, so if you can’t make one live, use your lunch break to play catch up once you get home.
- Consider signing up for the Hackathons, Security JAMs, Labs, Workshops, and Chalk Talks instead of breakout sessions. These are usually a really good investment of your re:Invent time where you get to interact and learn a lot. These are often not recorded and shared online, so taking advantage of these in person is a great opportunity not available after re:Invent is over.
- Avoid relying on the shuttle service if you have limited time between events in different hotels. Instead, consider using the Monorail system. This now seems to be the fastest and most consistent way to get around. Plan ahead, though, so you know where the entrances are, as you may not have time to do that while you are racing from event to event.
We are sure that there will be many new acronyms to learn after this year and lots of new services to sift through. One thing we do know for certain is that once the re:Invent dust has settled, 2nd Watch will be at the ready and by your side to help you consume and adopt the BEST solutions for your cloud journey. Swing by our booth, #2440, for some swag and a chat. This year we are giving away Amazon DeepLens cameras, and we are super excited to see you!
We also invite you to join us at our breakout session, ‘Proven Methodologies for Accelerating Your Cloud Journey.’ Here you will learn how to accelerate your journey to the cloud while implementing a cloud-first strategy without sacrificing the controls and standards required in a large, publicly-traded enterprise.
- Benefit from insights developed from working with some of the most recognized brands in the world.
- Discover how these household names leverage automation, CI / CD, and a modular approach to workload design to ensure consistent application of their security and governance requirements.
- Learn which approaches to use when transforming workloads to cloud native technologies, including serverless and containers.
With this approach, business users can finally receive properly governed resources without delaying or disrupting their need for agility, flexibility and cloud scale.
Finally, don’t forget to schedule a meeting with one of our AWS Professional Certified Architects, DevOps or Engineers while you’re at re:Invent. We would love to hear all about your cloud journey needs! That is all for now, we hope you are as excited as we are this year and can’t wait to see you in Las Vegas.
– Dustin Snyder, Cloud Practice Manager