Posted on

TWIET Episode 43

Welcome back to This Week in Enterprise Technology, Hyoun Park and Charles Araujo analyze the latest enterprise technology announcements and how they will affect your business and your bosses’ expectations.

Join TWIET as we guide CIOs and technical managers through the strategic ramifications behind the vendor hype, product innovation, and the avalanches of money going in and out of enterprise tech. As always, this podcast is available in audio, video, and broken up into sections for your benefit.

Audio Podcast: https://www.buzzsprout.com/2319034/episodes/16252199

This Week in Enterprise Technology, Hyoun Park and Charles Araujo critically assess last week’s biggest tech news:

  1. AWS Enhances Amazon Connect with Generative AI Tools
  2. AWS Takes on AI Hallucination Challenges
  3. AWS Bedrock Adds Multi-Agent Orchestration and Model Routing
  4. AWS Centralizes AI Efforts with SageMaker
  5. Casey Newton Examines AI Skepticism’s Comforts
  6. Emergence AI Coordinates Multi-Vendor Agents
  7. Exa Redefines Generative Search Experiences
  8. MLCommons Benchmarks LLM Output Risks
  9. South Korea’s Unrest Threatens Global Memory Supply
  10. Werner Vogels on Managing “Simplexity”
  11. Broadcom Adjusts to Minimize VMware Migration Risks

AWS Upgrades Amazon Connect with New Generative AI Features


Amazon Connect has been a successful cloud contact center product and contact center has been one of the clearest areas for AI to provide productivity benefits and increase potential revenue transactions,  AWS re:invent was an opportunity to announce the latest generative AI advancements within Connect. Charles and Hyoun discuss the opportunities for contact centers to adopt AI.

Source:
Maria Deutscher from Silicon Angle: https://siliconangle.com/2024/12/01/aws-upgrades-amazon-connect-new-generative-ai-features/ 


AWS Tackles AI Hallucinations

AWS launches Automated Reasoning checks to cross reference outputs with known facts and enterprise data. Although this is not as novel as AWS was stating, it is a valuable step forward. Hyoun and Charles debate the utility of this Automated Reasoning checks and whether AI hallucinations really matter or are just a sign of AI immaturity and inexperience. 

Source:

Kyle Wiggers on TechCrunch: https://techcrunch.com/2024/12/03/aws-new-service-tackles-ai-hallucinations/ 


AWS Bedrock Updates: Multi-Agent Collaboration, Model Routing

AWS announced interesting AI management updates for Amazon Bedrock. Both multi-agent management and prompt routing across models will be useful for enterprises seeking to expand the utility and cost structure of AI. Charles and Hyoun wonder if this agent management will cover the bill given the wide variety of agents that are starting to appear in the enterprise. . 

Source:

AWS: https://aws.amazon.com/blogs/aws/introducing-multi-agent-collaboration-capability-for-amazon-bedrock/ 


AWS Wraps Everything Together Under Sagemaker

AWS create a new umbrella brand that includes data studio, data lake, analytics, and data management. Hyoun and Charles argue about whether Sagemaker, best known as a data science tool, was the right umbrella brand for these data efforts.

Source:

AWS: https://aws.amazon.com/blogs/aws/introducing-the-next-generation-of-amazon-sagemaker-the-center-for-all-your-data-analytics-and-ai/ 


Casey Newton Examines AI Skepticism’s Comforts

One of TWIET’s favorite journalists, Casey Newton, weigh in on the false comfort of AI skepticism. Newton argues that the potential harm of AI is being underestimated by those who simply think that AI is full of lies or incompetent.  Charles and Hyoun discuss a more realistic path for IT departments to consider as they deploy AI.

Source:

Casey Newton on Platformer: https://www.platformer.news/ai-skeptics-gary-marcus-curve-conference/ 


Emergence AI Coordinates Multi-Vendor Agents

Start up Emergence AI announced its autonomous multi-agent AI orchestrator. At a time on every enterprise platform seems to be coming out with its own set of agents, Hyoun and Charles think it is about time for a third-party agent orchestration solution to hit the market and get some traction.

Source

Carl Franzen on VentureBeat: https://venturebeat.com/ai/emergences-ai-orchestrator-launches-to-do-what-big-tech-offerings-cant-play-well-with-others/ 


Exa Redefines Generative Search Experiences

The MIT Technology Review covered a startup named Exa taking a novel approach to Gen AI based web searches with the goal of using the web like a database. Charles and Hyoun discuss the scale and results for this approach.

Source:

Will Douglas Heaven on MIT Technology Review: https://www.technologyreview.com/2024/12/03/1107726/the-startup-trying-to-turn-the-web-into-a-database/ 


MLCommons Benchmarks LLM Output Risks

MLCommons has released its AIluminate 1.0 benchmarks to describe several categories of harm including sex crimes, violence, and defamation risks. Hyoun and Charles discuss past challenges regarding model benchmarking and risks. 

Source:

MLCommons: https://ailuminate.mlcommons.org/benchmarks/ 


South Korea’s Unrest Threatens Global Memory Supply

South Korea saw government unrest in an attempted military coup last week. Although we are not expert political scientists, international supply chains do affect our ability to source IT. We discussed the ramifications of South Korea earning 60% of the global memory, check market and considerations for the CIO in looking at geopolitical strife.

Source:

Prasanth Aby Thomas on CIO.com: https://www.cio.com/article/3617847/south-koreas-political-unrest-threatens-the-stability-of-global-tech-supply-chains.html 


Werner Vogels On Managing “Simplexity”

At Amazon re:invent, Amazon CTO pointed out both that complexity is inevitable and that there are two types of complexity that are important for technical audiences to consider, including a new concept of “simplexity”.. Hyoun is reminded of the Nassim Taleb concept of antifragility while Charles digs deeper into the strategic issues of technical debt. 

Source:

Tom Krazit on Runtime News: https://www.runtime.news/werner-vogels-complexity-is-inevitable/ 


Broadcom Adjusts to Minimize VMware Migration Risks

Broadcom has had to call back from its initial plans of making its top 2000 customers all direct and has handed much of that business back to its channels. With help from The  Register and Canalys, Hyoun and Charles discuss repercussions for tech sourcing. 

Source:

Simon Starwood on The Register: https://www.theregister.com/2024/12/05/vmware_user_migration_plans/ 

Posted on 3 Comments

Cloud Cost Management Part 4: Why Cloud FinOps Vendors All Sound The Same

Too often, the process of selecting a technology provider — of any kind — unearths more questions than answers. In many instances, vendors’ sales and marketing messages confuse, rather than clarify, because they all sound so similar. This puts IT, procurement, and finance leaders in the frustrating position of trying to identify real differentiators, all while hoping for the best outcomes.

Choosing a cloud computing cost management and optimization vendor offers no exception. As we noted in the third installment in our blog series, most (although not all) of these providers make the same benefits statements to potential customers. So, instead of leaning on hope, Amalgam Insights recommends enterprise buyers use our ongoing guidance to identify important differentiators. We begin by presenting similarities Amalgam Insights has noted in vendor messaging that prove confusing to potential buyers.

4 Areas of Confusing Messaging Among Cloud Cost Management Vendors

Recall that, in the previous blog, we pointed out continuous optimization and automation/artificial intelligence as the first two examples of similarities shared among cloud cost management vendors. The remainder of this installment covers the four additional issues we have pinpointed as challenges for evaluating Cloud FinOps providers. Keeping these aspects in mind will allow executives and line-of-business heads to spot providers’ true differences more easily rather than reinventing the wheel. This will go a long way toward arming organizations with the knowledge needed to develop a vendor selection process that will help narrow down the ideal choice.

1. Container and Service Management

With the emergence of Kubernetes as a mainstream containerization platform, cloud computing can now be deployed more granularly. This makes cost and resource tracking even harder. When a workload is not attached to a specific resource or service, IT has more difficulty assigning it to a project or cost center. Organizations supporting stateless apps need to figure out how to track cloud usage. To meet this challenge, vendors will toss around the buzzphrase “Kubernetes management.” The tracking of containerized compute can be done proactively, optimizing nodes in expectation of workloads or reactive ways that look at the usage. Get insight from the vendor on how they support consumption below the application layer as “container management” is being used in a variety of ways to describe cost, operations, technology, workflow, and/or infrastructure accounting in various ways.

2. Single View of Multiple and Hybrid Clouds

Another commonality among solutions in our Amalgam Insights’ new report, Control Your Cloud: Selecting Cloud Cost Management in the Face of Recession, is that of the single interface. In this report, we focused on cloud cost management and optimization providers that bring together multiple cloud vendors and hybrid cloud resources (e.g., Amazon Web Services, Microsoft Azure, Google Cloud Platform, niche players, private clouds, on-premises hardware) under one roof. Rather than forcing users to access each cloud provider’s interface separately, third-party vendors’ management platforms deliver insight and reporting into each cloud through one portal. This reflects one of the basic benefits of using an independent cloud cost management and optimization platform. A variety of companies in the cloud cost management marketplace are still specialists in one or two cloud platforms. Make sure that your proposed vendor for cloud costs is aligned with your IT architects’ vision for cloud and data center usage.

3. Reporting and Analytics

Every cost management and optimization platform — cloud or not — contains reporting and analytics. The detail to look for is the depth and granularity of analytics, including the out-of-the-box alignment to IT, DevOps, finance, procurement, and other relevant cost and inventory management departments. Analytics can also be supported by algorithmic and machine learning models that help to predict future demand for resources, or that proactively detect potential opportunities for optimization. However, the presence of analytic and reporting capabilities that provide financial and operational visibility into multiple clouds is not in itself a differentiator within the cloud cost management world.

4. Managed and Professional Services

In addition to software, most cloud cost management and optimization vendors offer some level of professional or managed services, as well as help desk. While none of this is unique, the ways in which the services are delivered could be. Organizations will want to vet variances including the following:

  • Hours of Operation
  • Human vs. automated assistance
  • Dedicated or named account resources
  • Cloud provider certifications

Some organizations will require around-the-clock support availability while others will not. Some will have no issue using chatbots to resolve problems while others will want a human. Some will operate well with general assistance while others will opt for personnel dedicated to their account. Finally, some cloud cost management and optimization vendors may not certify all their staff on the various cloud platforms the organization uses.

Knowledge Is Power

Knowing what makes many cloud cost management vendors the same will equip IT, procurement, finance, inventory, and other leaders to pinpoint meaningful differentiators and therefore choose an ideal fit. Amalgam Insights has done much of the footwork for readers. In that spirit, the next blog will cover the key differentiators that analysts have identified among providers. From there, we will publish a number of vendor profiles. Combined, all this information will support organizations’ quests to most ably manage their cloud computing environments, especially as a global recession threatens to hit.

Need More Guidance Now?

Check out Amalgam Insights’ new Vendor SmartList report, Control Your Cloud: Selecting Cloud Cost Management in the Face of Recession, available for purchase. If you want to discuss your Cloud Cost Management challenges, please feel free to schedule time with us.