Microsoft SQLPackage: Exciting innovations for data management and provisioning

There’s exciting news from Microsoft that specifically affects data management and provisioning. The SQLPackage tool, already indispensable to many of us, has received an impressive update. With preview support for extracting and publishing data stored in Parquet files in Azure Blob Storage, it opens up a new world of possibilities for managing data in Azure SQL Managed Instances and SQL Server 2022.

Anna Hoffman pointed this out in a tweet, and we will examine these exciting new features in detail. Click here for the release notes.

Parquet support: The key to data management in the cloud

One of the most exciting additions in this SQLPackage update is undoubtedly the support for Parquet files. Parquet is an efficient, column-oriented file format often used in big data scenarios in particular and in the cloud. This update allows us to extract data from Parquet files in Azure Blob Storage and publish it to Azure SQL Managed Instances or SQL Server 2022. This opens up completely new possibilities for managing data more efficiently and cost-effectively.

Fixes for the use of SQLPackage and Azure Synapse Analytics

In the latest release, 162.0.52 of the SQLPackage tool, important improvements have been introduced specifically for Azure Synapse Analytics. These updates address several issues, including properly setting the default command timeout when connecting to serverless SQL pools in Azure Synapse Analytics. Furthermore, issues related to determining the default data and log paths and the default login, user and log paths of serverless SQL pools have been fixed. These updates strengthen the integration of SQLPackage in Azure Synapse Analytics and improve the reliability and efficiency of managing data in this environment.

Azure SQL Managed Instance and SQL Server 2022: The future of data management

Preview support for Parquet in SQLPackage is particularly exciting for those already on Azure SQL Managed Instance or planning to migrate to SQL Server 2022. These platforms offer advanced capabilities for managing data in the cloud and on-premises. With the ability to integrate Parquet data into these environments, data management becomes even more powerful.

Fixes in connection with SQL Server 2022

About SQL Server 2022, the latest release, 162.0.52 of the SQLPackage tool, fixes two important issues. Firstly, a bug has been fixed where the DATETRUNC function was not recognized as an integrated function in the previous version. This is particularly relevant as the DATETRUNC function in SQL Server 2022 is a useful method for date manipulation. Furthermore, a problem with the DATE_BUCKET function, which was also not correctly recognized as a built-in function, has been fixed. These updates are based on valuable feedback from the developer community and ensure the smooth use of these functions in SQL Server 2022.

How does it all work? – Upgrading or reinstalling the new version

To upgrade or reinstall the latest version of the SQLPackage tool, follow the steps in the official installation guide. These instructions ensure that you are always up to date and benefit from the latest features and bug fixes.

The .NET Core SDK v6.0 or higher is required to install SQLPackage as a dotnet tool. Installing SQLPackage as a global tool makes it available in your path as “SQLpackage” and is recommended for Windows, macOS and Linux. Here is how to install SQLPackage as a global .NET tool:

dotnet tool install -g microsoft.sqlpackage

Further options for the dotnet tool install command can be found in the documentation for installing the dotnet tool.

If you have already installed an older version of SQLPackage and want to update to the latest version, use this command:

dotnet tool update -g microsoft.sqlpackage

If you want to uninstall SQLPackage, you can use the following command:

dotnet tool uninstall -g microsoft.sqlpackage

By regularly upgrading or reinstalling SQLPackage, you can ensure that you always have the latest features and improvements to perform your data management tasks efficiently.

Learn more

I recommend consulting the official Microsoft documentation for full technical details and step-by-step instructions on using SQLPackage with Parquet files. There, you will find all the information you need to get the most out of these exciting new features.

Conclusion

This new SQLPackage update is undoubtedly a significant advancement in data management and delivery. With Parquet support and integration with Azure SQL Managed Instances and SQL Server 2022, there are many opportunities for greater efficiency and flexibility in our work.

We’re excited to see how these new capabilities will change how we manage and deliver data. It’s an exciting time to be a database administrator, and these innovations further prove how dynamic and progressive our community is.

We encourage you to explore and experiment with these new features in SQLPackage. And, of course, we look forward to hearing your thoughts and experiences with this exciting update. Share your insights in the comments, and let’s continue the discussion about the future of data management.

Stay tuned for more updates and possibilities in the exciting world of data management!

Björn Peters

Björn continues to work from Greece as a Senior Consultant – Microsoft Data Platform and Cloud for Kramer&Crew in Cologne. He also remains loyal to the community from his new home, he is involved in Data Saturdays or in various forums. Besides the topics around SQL Server, Powershell and Azure SQL, he is interested in science fiction, baking 😉 and cycling.