Bulk insert with Azure SQL

Comments

Felipe Daiello 2/18/2022 1:42:26 PM

I have not tested myself, but acording to the article below, it its possible to make a BULK INSERT from a Blob Storage to Azure SQL. https://techcommunity.microsoft.com/t5/azure-sql-blog/loading-files-from-azure-blob-storage-into-azure-sql-database/ba-p/386133

Jeffrey Rosselle 3/1/2022 10:56:03 AM

Hi Felipe. Thanks for the headsup. This is an old post, so It's possible that Microsoft released an update so you use "the normal way".

Taysha 9/28/2020 7:49:57 PM

Thank you for the article, Jeffrey! What do you think of alternative ways to perform bulk operations with Azure SQL such as Skyvia tool https://skyvia.com/connectors/sql-azure? What are pros and cons on your opinion?

Jeffrey Rosselle 10/1/2020 10:36:45 AM

Hi Taysha. Unfortunately I have no experience with Skyvia. So it's a bit hard to tell the pros and cons about the service itself. In general you could say a Pro could be that the services is more userfriendly then the use of console commands. Also it might have more features. A Con could be that you have to process your data through a 3rd party service. Your data might contains sensitive data, maybe it could cause some privacy issue (GDPR, CCPA,...) if you data is processed by an other party.

Caroline 2/24/2020 5:17:10 PM

Thanks for this article!! It helped me a lot to get a table with 2 million + records to Azure.

Jeffrey Rosselle 2/24/2020 6:19:18 PM

Thanks for the compliment. I’m glad it helped you out!

Karan 1/15/2019 5:26:08 AM

Check out this article on Bulk Insert using T-SQL procedures on Azure https://medium.com/datadriveninvestor/bulk-insert-into-azure-database-using-blob-storage-f1fbc2d65325

Julien 4/8/2016 7:04:00 AM

Hello, thank you your article is very helpful! <br /> What is the best way to clear the data in the target table before doing the bulk insert? <br /> Thanks!

Horia 6/23/2016 10:31:00 AM

I am using TRUNCATE TABLE to clean the target tables.

Jeffrey Rosselle 6/24/2016 7:40:00 AM

Good call! Although it’s quite similar as the DELETE statement, it is indeed better to use.

Florian Mayer 7/2/2020 9:47:21 AM

DELETE only deletes all recoredsets in the table. TRUNCATE deletes all recoredsets in the table and reseeds the PrimaryKey. If you only delete the records a new record will be inserted with the last known key + 1. After truncate a new record is inserted with PrimaryKeyId 1. So truncate is the cleanest way to start up table-data from scratch.