Amazon Athena now supports Apache Hudi 0.12.2 - devamazonaws.blogspot.com

You can now use Amazon Athena to query tables created with Apache Hudi 0.12.2 which includes support for improved scalability of queries accessing data sets in Amazon S3 data lake. The updated integration enables you to use Athena to query Hudi 0.12.2 tables managed via Amazon EMR, Apache Spark, Apache Hive or other compatible services.

Post Updated on May 09, 2023 at 06:05PM

Comments

Post a Comment

Popular posts from this blog

[MS] Boosting Azure DevOps Security with GHAS Code Scanning - devamazonaws.blogspot.com

Image
Debjyoti Ganguly shares insights on the security benefits and configuration of GHAS Code Scanning with Azure DevOps. Boosting Azure DevOps Security with GHAS Code Scanning Code scanning, a pipeline-based tool available in GitHub Advanced Security, is designed to detect code vulnerabilities and bugs within the source code of ADO (Azure DevOps) repositories. Utilizing CodeQL as a static analysis tool, it performs query analysis and variant analysis. When vulnerabilities are found, it generates security alerts. CodeQL CodeQL is a powerful static analysis tool used for showing vulnerabilities and bugs in source code. It enables developers to write custom queries that analyze codebases, searching for specific patterns and potential security issues. By converting code into a database format, CodeQL allows for sophisticated, database-like queries to detect flaws. CodeQL in Action 1. Preparing the Code Create a CodeQL Database : Extract and structure the code into a database for analy...
Read more

[MS] GitHub Copilot upgrade assistant for Java技术预览发布 - devamazonaws.blogspot.com

随着人工智能和大型语言模型（LLMs）的不断发展，Agent(“智能代理”)和智能代理化工作流程正在迅速成为AI领域的下一个前沿。这些自主系统带来了巨大的好处，它们可以创建计划、执行单个任务、使用外部工具、与用户互动，甚至自行修复错误。 凭借这些功能，代理化工作流程可以解决一些企业客户在开发周期中经常遇到的复杂、关键任务，甚至是一些极其繁琐的任务。对于使用Java的企业客户来说，升级JDK、框架、依赖项等一直是一个挑战。这些挑战覆盖的范围相当地广，开发者可能会需要经常面对重复且繁琐的场景，例如API签名发生变化等等。我们见过一些企业在将代码库从Java 8升级到Java 17时，花费了几天甚至几周的时间，这是一项巨大的资源和人力投入。 今天，我们很高兴宣布 GitHub Copilot upgrade assistant Java的技术预览版 。这是一个基于AI的解决方案，它使用智能代理化工作流程和多代理框架帮助您更新Java应用程序。通过安装 Visual Studio Code 插件，您可以从本地Java项目开始，GitHub Copilot将自动处理大部分升级过程。以下是该产品的一些关键功能。 创建一个智能的计划 GitHub Copilot upgrade assistant for Java 会分析您当前的项目，并提示用户输入JDK和Maven路径、分支名称等参数。点击“Start(开始)”后，工具将进一步评估该项目的依赖项，例如Spring Boot和JUnit等框架。您还可以选择生成一个GitHub Issue，记录升级过程中的任务。 您可以在执行计划前，审核即将执行的任务。以下是一个演示。 [video width="1920" height="1080" mp4="https://devblogs.microsoft.com/java/wp-content/uploads/sites/51/2024/10/plan.mp4"][/video] 可视化每一步操作 当升级开始后，工具的信息面板(Dashboard)将成为主要信息中心，您可以在此查看每个任务的实时详情，包括运行 OpenRewrite 工具的命令、查看选择的配方、审查修改的文件和错误详情、每个步骤日志等。您还可以深入探索每个...
Read more

AWS SAM CLI adds AWS CloudFormation Language Extensions support to accelerate local serverless development - devamazonaws.blogspot.com

AWS SAM CLI now supports AWS CloudFormation Language Extensions , enabling you to reduce duplication in your infrastructure as code (IaC) templates while retaining the full local development workflow. This accelerates your serverless development by letting you define resources once and iterate locally without waiting for cloud deployments. Developers frequently need to define multiple similar resources, such as Lambda functions, DynamoDB tables, or SNS topics, from a single template definition. However, developers who use SAM CLI to build, test, and deploy their serverless applications previously could not process templates that use CloudFormation Language Extensions. This required choosing between reducing template duplication and using SAM CLI for local development. Now, SAM CLI processes Language Extensions in memory for local operations while preserving your original template for CloudFormation deployment. You can define your resources once and test them locally across all SAM C...
Read more