返回顶部
首页 > 资讯 > 操作系统 >Azure - AzCopy学习
  • 367
分享到

Azure - AzCopy学习

azure学习Blob 2023-08-30 11:08:34 367人浏览 安东尼
摘要

使用 AzCopy 将本地数据迁移到云存储空间 azcopy login 创建存储账号 ./azcopy login --tenant-id 40242385-c249-4746-95dc-4a0b64d49dc5 这里的—ten

使用 AzCopy 将本地数据迁移到云存储空间

  1. azcopy login

    1. 创建存储账号
    ./azcopy login --tenant-id 40242385-c249-4746-95dc-4a0b64d49dc5
    • 这里的—tenant-id 在下面的地方查看:目录 ID;需要拥有Storage Blob Data Owner 的权限
    • 账号下可能会有很多目录(tenant),所以在 login 的时候带上 —tenant-id

在这里插入图片描述

  1. 使用 azcopy copy 上传

    azcopy copy 20230509_144654178_iOS.jpg https://eastorageaccountpg.blob.core.windows.net/private-pg

    修改文件名和 endpoint 即可。

如果使用 az 命令也可以打到效果

az storage blob upload -f 20230509_144654178_ioS.jpg -c blog-pg -n 20230509_144654178_iOS.jpg

AzCopy Sync 使用

在这里插入图片描述

 1. azcopy sync,Client local Dir → EU:Blob/container/dir    - Client未登录 Azure    - blob 的 container 生成共享访问令牌,注意权限选择

在这里插入图片描述

Client 执行 azcopy sync 命令with SAS

        root@ubuntu0:~# azcopy sync "./blog/" "Https://eustoragesacc0.blob.core.windows.net/eucontainer?sp=racwdlep&st=2023-07-21T12:27:30Z&se=2023-07-21T20:27:30Z&spr=https&sv=2022-11-02&sr=c&sig=edSES09iSGU1xChuOAJnEKNrTJ1xbk0pR97aO%2FA0boE%3D"        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job e08f5117-f8b7-314d-5aa3-3f22b0fdf82b has started        Log file is located at: /root/.azcopy/e08f5117-f8b7-314d-5aa3-3f22b0fdf82b.log                100.0 %, 2 Done, 0 Failed, 0 Pending, 2 Total, 2-sec Throughput (Mb/s): 0.6465                Job e08f5117-f8b7-314d-5aa3-3f22b0fdf82b Summary        Files Scanned at Source: 2        Files Scanned at Destination: 0        Elapsed Time (Minutes): 0.0667        Number of Copy Transfers for Files: 2        Number of Copy Transfers for Folder Properties: 0         Total Number Of Copy Transfers: 2        Number of Copy Transfers Completed: 2        Number of Copy Transfers Failed: 0        Number of Deletions at Destination: 0        Total Number of Bytes Transferred: 423810        Total Number of Bytes Enumerated: 423810        Final Job Status: Completed

查看 Blob 情况

在这里插入图片描述

  1. EA:blob/container/dir → EU:blob/container/dir

    • ea 源生成 SAS,注意权限
      在这里插入图片描述

    • Client 执行 azcopy sync 命令with SAS

      root@ubuntu0:~# azcopy sync "https://eastorageacc0.blob.core.windows.net/eacontainer/sync/?sp=rle&st=2023-07-21T12:42:42Z&se=2023-07-21T20:42:42Z&spr=https&sv=2022-11-02&sr=c&sig=%2FZzdp1B5dpZzTGT3PlwhssFKnipWkgp%2BBpOIqo9t1mY%3D" "https://eustoragesacc0.blob.core.windows.net/eucontainer/sync/?sp=racwdlep&st=2023-07-21T12:27:30Z&se=2023-07-21T20:27:30Z&spr=https&sv=2022-11-02&sr=c&sig=edSES09iSGU1xChuOAJnEKNrTJ1xbk0pR97aO%2FA0boE%3D"INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder supportJob 747202e5-1afc-b846-4388-9e2e4eee6c58 has startedLog file is located at: /root/.azcopy/747202e5-1afc-b846-4388-9e2e4eee6c58.log100.0 %, 3 Done, 0 Failed, 0 Pending, 3 Total, 2-sec Throughput (Mb/s): 0   Job 747202e5-1afc-b846-4388-9e2e4eee6c58 SummaryFiles Scanned at Source: 3Files Scanned at Destination: 0Elapsed Time (Minutes): 0.1Number of Copy Transfers for Files: 3Number of Copy Transfers for Folder Properties: 0 Total Number Of Copy Transfers: 3Number of Copy Transfers Completed: 3Number of Copy Transfers Failed: 0Number of Deletions at Destination: 0Total Number of Bytes Transferred: 847620Total Number of Bytes Enumerated: 847620Final Job Status: Completed
    • 查看 Blob 情况

    在这里插入图片描述

  • AzCopy copy 示例

    azcopy copy "https://eascc20230728.blob.core.windows.net/local/1.txt?sp=racwli&st=2023-07-31T03:54:41Z&se=2023-08-31T11:54:41Z&spr=https&sv=2022-11-02&sr=c&sig=hRxFYgG3chofx1WUwlb0ji5wPuI%2BgA31DxUNZlPjAW4%3D" ./1.txt

Blob bw Regions test

![在这里插入图片描述](https://img-blog.csdnimg.cn/b013af0918f54b4c8a09abaa052b20af.jpeg#pic_center)
序号说明测试 1测试 2测试 3平均值
1EA client → SA Container0.23340.2334
2SA Container → EU client1.02631.26751.01481.10286667
3SA Container → EU client @ peer created1.12091.24491.14831.17136667
4SA Container → EU Container4.16814.3354.63514.3794
2 Hours Later1.43381.86731.65055
5EU Contaner → SA Container1.00030.93360.96695
6EU client → EU Container0.7670.76690.7670.76696667
7EU Container → EU Client, VM disk iops limited0.88140.8814
8EA client →EU Container0.53350.70020.61685
9EU container → EA container0.40010.4001

结论:
1. Client 跨Region 获取 Container 中文件,在 Blog 选择微软内网优先的情况下,Region间是否使用 Peer 对等对传输效率基本无影响;
2. Container 的文件直接跨 Region 传输效率与选择的 Region以及时机/方向 有关,一段时间保持稳定;
3. 同 Region 传输效率高;

原始数据

    1. EA client → SA Container                root@ubuntu0:/home/zyi# azcopy copy 1.zip https://sastorageac0.blob.core.windows.net/sacontainer        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to destination using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job f631ebf2-8060-6b47-7164-58044ee0c43c has started        Log file is located at: /root/.azcopy/f631ebf2-8060-6b47-7164-58044ee0c43c.log                100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                       Job f631ebf2-8060-6b47-7164-58044ee0c43c summary        Elapsed Time (Minutes): 0.2334        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed            2. SA Container → EU client                root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job bf9d0ff0-6066-2140-4cb9-8716e4272028 has started        Log file is located at: /root/.azcopy/bf9d0ff0-6066-2140-4cb9-8716e4272028.log                0.0 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s):0.0 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total,                         2.1 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s):6.2 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s):11.0 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)15.9 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)20.3 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)24.6 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)29.1 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)33.7 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)38.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)42.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)46.9 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)51.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)55.3 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)59.7 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s)64.4 %, 0 68.9 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 1710.624 (Disk may be l73.4 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 1845.0545 (77.3 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 1440.6049  82.5 %, 0 Done, 0 Failed, 1 Pending, 0 Skipped, 1 Total, 100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                       Job bf9d0ff0-6066-2140-4cb9-8716e4272028 summary        Elapsed Time (Minutes): 1.0263        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed                #download 2                root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job 732e37c9-9e99-364a-4a4e-fa7484fac927 has started        Log file is located at: /root/.azcopy/732e37c9-9e99-364a-4a4e-fa7484fac927.log                100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                      Job 732e37c9-9e99-364a-4a4e-fa7484fac927 summary        Elapsed Time (Minutes): 1.2675        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed                #download 3        ^[[Aroot@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job 05c9210a-e503-c046-6f9b-853d6c9a3c4e has started        Log file is located at: /root/.azcopy/05c9210a-e503-c046-6f9b-853d6c9a3c4e.log                100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                       Job 05c9210a-e503-c046-6f9b-853d6c9a3c4e summary        Elapsed Time (Minutes): 1.0148        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed        ```            3. SA Container → EU client @ peer created                ```powershell        root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job b1d8da46-9358-6b4c-66d4-bb8cb8d53e1f has started        Log file is located at: /root/.azcopy/b1d8da46-9358-6b4c-66d4-bb8cb8d53e1f.log                100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                      Job b1d8da46-9358-6b4c-66d4-bb8cb8d53e1f summary        Elapsed Time (Minutes): 1.1209        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed                #2        root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job b646e5c1-af07-6c41-7a0c-641ecfd5d1cd has started        Log file is located at: /root/.azcopy/b646e5c1-af07-6c41-7a0c-641ecfd5d1cd.log                100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                      Job b646e5c1-af07-6c41-7a0c-641ecfd5d1cd summary        Elapsed Time (Minutes): 1.2449        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed                root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip .        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job 30f70c4e-fdd1-9a4b-6e89-c5e7406970de has started        Log file is located at: /root/.azcopy/30f70c4e-fdd1-9a4b-6e89-c5e7406970de.log                100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                       Job 30f70c4e-fdd1-9a4b-6e89-c5e7406970de summary        Elapsed Time (Minutes): 1.1483        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed        ```                1. SA Container → EU Container                ```powershell        root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip         INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to destination using Azure AD        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job 9168f92f-2da4-6742-6862-8e5696b52a41 has started        Log file is located at: /root/.azcopy/9168f92f-2da4-6742-6862-8e5696b52a41.log                INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                 Job 9168f92f-2da4-6742-6862-8e5696b52a41 summary        Elapsed Time (Minutes): 4.1681        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed                root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/10.zip         INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to destination using Azure AD        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job 7cca86e8-11b6-164d-7b33-887d9cf10183 has started        Log file is located at: /root/.azcopy/7cca86e8-11b6-164d-7b33-887d9cf10183.log                INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                 Job 7cca86e8-11b6-164d-7b33-887d9cf10183 summary        Elapsed Time (Minutes): 4.335        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed                #3        root@eu-ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip         INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to destination using Azure AD        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job c4366598-5822-b946-45b9-6ee9d6f6df15 has started        Log file is located at: /root/.azcopy/c4366598-5822-b946-45b9-6ee9d6f6df15.log                INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                 Job c4366598-5822-b946-45b9-6ee9d6f6df15 summary        Elapsed Time (Minutes): 4.6351        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed                #4        root@ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to destination using Azure AD        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job 15fe8cca-78c3-3d40-4a55-e90d11495258 has started        Log file is located at: /root/.azcopy/15fe8cca-78c3-3d40-4a55-e90d11495258.log                INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                 Job 15fe8cca-78c3-3d40-4a55-e90d11495258 summary        Elapsed Time (Minutes): 1.4338        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed                #5        root@ubuntu0:/home/zyi# azcopy copy https://sastorageac0.blob.core.windows.net/sacontainer/1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to destination using Azure AD        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job 2ac14c6f-f943-9c4b-7477-6947fd59ab31 has started        Log file is located at: /root/.azcopy/2ac14c6f-f943-9c4b-7477-6947fd59ab31.log                INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                 Job 2ac14c6f-f943-9c4b-7477-6947fd59ab31 summary        Elapsed Time (Minutes): 1.8673        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed        ```            2. EU Contaner → SA Container                ```powershell        root@ubuntu0:/home/zyi# azcopy copy https://eustorageac0.blob.core.windows.net/eucontainer/10.zip https://sastorageac0.blob.core.windows.net/sacontainer        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to destination using Azure AD        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job 8b6f339f-e23b-2f4e-755c-8bd336942b40 has started        Log file is located at: /root/.azcopy/8b6f339f-e23b-2f4e-755c-8bd336942b40.log                INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                 Job 8b6f339f-e23b-2f4e-755c-8bd336942b40 summary        Elapsed Time (Minutes): 1.0003        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed                #2        root@ubuntu0:/home/zyi# azcopy copy https://eustorageac0.blob.core.windows.net/eucontainer/10.zip https://sastorageac0.blob.core.windows.net/sacontainer/1.zip        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to destination using Azure AD        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job 0c1039f0-7a9f-0e44-6a42-079c03708fb8 has started        Log file is located at: /root/.azcopy/0c1039f0-7a9f-0e44-6a42-079c03708fb8.log                INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                 Job 0c1039f0-7a9f-0e44-6a42-079c03708fb8 summary        Elapsed Time (Minutes): 0.9336        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed                ```                1. EU client → EU Container                ```powershell        root@eu-ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip         INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to destination using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job d3bdc10a-4142-8b41-7f9a-752c840c5f36 has started        Log file is located at: /root/.azcopy/d3bdc10a-4142-8b41-7f9a-752c840c5f36.log                100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 623.3303                Job d3bdc10a-4142-8b41-7f9a-752c840c5f36 summary        Elapsed Time (Minutes): 0.767        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed                #2        root@eu-ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip         INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to destination using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job 3018151c-c777-ca42-4054-7f980de47650 has started        Log file is located at: /root/.azcopy/3018151c-c777-ca42-4054-7f980de47650.log                100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 598.946                 Job 3018151c-c777-ca42-4054-7f980de47650 summary        Elapsed Time (Minutes): 0.7669        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed                #3        root@eu-ubuntu0:/home/zyi# azcopy copy 1.zip https://eustorageac0.blob.core.windows.net/eucontainer/1.zip         INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to destination using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job 33cf320d-94a5-aa48-5a35-b94d34cf5cc1 has started        Log file is located at: /root/.azcopy/33cf320d-94a5-aa48-5a35-b94d34cf5cc1.log                100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total, 2-sec Throughput (Mb/s): 579.6335                Job 33cf320d-94a5-aa48-5a35-b94d34cf5cc1 summary        Elapsed Time (Minutes): 0.767        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed        ```            2. EU Container → EU Client, VM disk iops limited                ```powershell        root@eu-ubuntu0:/home/zyi# azcopy copy  https://eustorageac0.blob.core.windows.net/eucontainer/1.zip 10.zip        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job 038b5c4a-7376-094d-4e7c-c958e15378f8 has started        Log file is located at: /root/.azcopy/038b5c4a-7376-094d-4e7c-c958e15378f8.log                100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                       Job 038b5c4a-7376-094d-4e7c-c958e15378f8 summary        Elapsed Time (Minutes): 0.8814        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed        ```                1. EA client →EU Container                ```powershell        root@ubuntu0:/home/zyi# azcopy copy  1.zip https://eustorageac0.blob.core.windows.net/eucontainer        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to destination using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job e197a453-cd7d-9042-53bc-de6c0e26246c has started        Log file is located at: /root/.azcopy/e197a453-cd7d-9042-53bc-de6c0e26246c.log                100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                      Job e197a453-cd7d-9042-53bc-de6c0e26246c summary        Elapsed Time (Minutes): 0.5335        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed                #2        root@ubuntu0:/home/zyi# azcopy copy  1.zip https://eustorageac0.blob.core.windows.net/eucontainer/10.zip        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to destination using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job 6b1b50a2-3c6c-9c45-5165-085514255e76 has started        Log file is located at: /root/.azcopy/6b1b50a2-3c6c-9c45-5165-085514255e76.log                100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                      Job 6b1b50a2-3c6c-9c45-5165-085514255e76 summary        Elapsed Time (Minutes): 0.7002        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed                ```            2. EU container → EA container                ```powershell        root@ubuntu0:/home/zyi# azcopy copy https://eustorageac0.blob.core.windows.net/eucontainer/10.zip https://eastorageaccountpg.blob.core.windows.net/blog-pg        INFO: Scanning...        INFO: Autologin not specified.        INFO: Authenticating to destination using Azure AD        INFO: Authenticating to source using Azure AD        INFO: Any empty folders will not be processed, because source and/or destination doesn't have full folder support                Job 04a69131-382f-3741-4263-c81b6e28c27e has started        Log file is located at: /root/.azcopy/04a69131-382f-3741-4263-c81b6e28c27e.log                INFO: Transfers could fail because AzCopy could not verify if the destination supports tiers.        100.0 %, 1 Done, 0 Failed, 0 Pending, 0 Skipped, 1 Total,                 Job 04a69131-382f-3741-4263-c81b6e28c27e summary        Elapsed Time (Minutes): 0.4001        Number of File Transfers: 1        Number of Folder Property Transfers: 0        Number of Symlink Transfers: 0        Total Number of Transfers: 1        Number of File Transfers Completed: 1        Number of Folder Transfers Completed: 0        Number of File Transfers Failed: 0        Number of Folder Transfers Failed: 0        Number of File Transfers Skipped: 0        Number of Folder Transfers Skipped: 0        TotalBytesTransferred: 10519930170        Final Job Status: Completed        ```

来源地址:https://blog.csdn.net/weixin_43394724/article/details/132498738

--结束END--

本文标题: Azure - AzCopy学习

本文链接: https://lsjlt.com/news/382688.html(转载时请注明来源链接)

有问题或投稿请发送至: 邮箱/279061341@qq.com    QQ/279061341

猜你喜欢
  • Azure - AzCopy学习
    使用 AzCopy 将本地数据迁移到云存储空间 azcopy login 创建存储账号 ./azcopy login --tenant-id 40242385-c249-4746-95dc-4a0b64d49dc5 这里的—ten...
    99+
    2023-08-30
    azure 学习 Blob
  • 来 Azure 学习 OpenAI 三 - 用 Python 调用 Azure OpenAi API
    大家好,我是微软学生大使 Jambo。在我们申请好 Azure 和 Azure OpenAI 之后,我们就可以开始使用 OpenAI 模型了。如果你还没有申请 Azure 和 Azure OpenAI...
    99+
    2023-09-13
    azure python chatgpt openai
  • 【机器学习 Azure Machine Learning】Azure Machine Learning 访问SQL Server 无法写入问题 (使用微软Python AML Core SDK)
    问题情形  使用Python SDK在连接到数据库后,连接数据库获取数据成功,但是在Pandas中用 to_sql 反写会数据库时候报错。错误信息为:ProgrammingError: (‘42000‘, "[42000] [Microso...
    99+
    2015-11-09
    【机器学习 Azure Machine Learning】Azure Machine Learning 访问SQL Server 无法写入问题 (使用微软Python AML Core SDK)
  • 机器学习:无监督学习
    文章目录 线性学习方法聚类ClusteringKmeansHAC 分布表示降维PCAMatrix FactorizationManifold LearningLLELaplacian Eigenmapst-SEN ...
    99+
    2023-08-30
    机器学习 无监督学习
  • Java学习星球,Java学习路线
    目录 一、Java学习路线二、学习计划三、为何会有Java学习星球?四、加入星球后,你可以得到什么?五、如何加入Java学习星球?六、打卡挑战 大家好,我是哪吒,一个靠着热情攀登至C...
    99+
    2023-08-31
    java 学习 开发语言
  • 【李沐】动手学深度学习 学习笔记
    目录 【内容介绍】动手学深度学习-基于pytorch版本【脉络梳理】预备知识数据操作数据预处理线性代数矩阵计算自动求导 线性神经网络线性回归深度学习的基础优化算法线性回归的从零开始实现线...
    99+
    2023-08-31
    深度学习 学习 python
  • redis学习
    邻近年底,决定辞职,自认为即使没有找到很满意的工作,也应该不会差。事实是有点自信回头,虽然找到了工作,但途中也受到了打击,不得不承认学习的激情不知何时,渐渐熄灭。直到认识一个女生,她让我对未来充满着信心。曾今何时,也在这写过一些...
    99+
    2021-09-30
    redis学习
  • 学习oracle
    下载oracle网址http://www.oracle.com/technetwork/index.html根据你的机型选择下载安装不同版本,首先你得注册一个oracle账户才能下载。官网EX Editio...
    99+
    2024-04-02
  • Oracle学习
    001——在现有的表上新建表Create table t2as select ename name,sal salary from emp;当t2诞生时就会有子查询中所查出的数据。如果想改变列的名...
    99+
    2024-04-02
  • nfs学习
    一、实验要求    (1) nfs server导出/data/application/web;    (2) nfs cli...
    99+
    2024-04-02
  • xtrabackup学习
    xtrabackup安装 https://www.percona.com/downloads/XtraBackup/LATEST/ 下载相应版本包  wget ftp://rpmfind...
    99+
    2024-04-02
  • EventSource学习
    一、EventSource的基本概念 EventSource是HTML5中的一种新的API,用来实现服务器端向客户端推送事件。相比于常规的轮询方式,EventSource可以实现更加高效、低延迟的数据...
    99+
    2023-09-21
    学习 服务器 网络
  • Python学习
    Python是创始人吉多•范罗苏姆(Guido van Rossum)在1989年圣诞节期间,在阿姆斯特丹,为了打发圣诞节的无趣,决心开发一个新的脚本解释程序,而在给自己新创造的计算机语言起名字的时候,由于其是,自于七十年代风靡全球的英国六...
    99+
    2023-01-31
    Python
  • Python 学习
    第一次学习python查阅的资料一,熟悉基本在正式介绍python之前,了解下面两个基本操作对后面的学习是有好处的:1)基本的输入输出 可以在Python中使用+、-、*、/直接进行四则运算。11+3*3查看全部10(2)导入模块 使用im...
    99+
    2023-01-31
    Python
  • 学习python
    亲爱的朋友:     欢迎你!很高兴能在这里见到你,你能来到这里说明你真的很喜欢python,很想把python给学好!我觉的你很幸运,开始我学python的时候比较少资料,学起来也比较头疼,现在随着python越来越流行,资料也越来越多,...
    99+
    2023-01-31
    python
  • OSPFv3学习
     OSPF是一种链路状态路由协议。它具有标准开放、收敛迅速、无环路、便于层级化设计等众多优点。IPv4网络中广泛使用的OSPFv2协议由于在报文内容、运行机制等方面与IPv4地址联系得过于紧密,大大制约了它的可扩展性和适应性。在IPv6环...
    99+
    2023-01-31
  • jbpm学习
    转http://linliangyi2007.javaeye.com/blog/176345本片文章,我们将从业务流程的设计开始,通过带领大家完成一个完整工作流的程序设计,来学习jPDL的使用。业务流程设计这里我们实现一个相对简化的公司借款...
    99+
    2023-06-03
  • 【数据科学系统学习】机器学习算法 #
    本篇内容为《机器学习实战》第 6 章 支持向量机部分程序清单。所用代码为 python3。 支持向量机优点:泛化错误率低,计算开销不大,结果易解释。 缺点:对参数调节和核函数的选择敏感,原始分类器不加修改仅适用于处理二分类问题。适用数据...
    99+
    2023-01-31
    算法 机器 科学
  • Neo4j/cypher学习笔记与学习建议
    简介 本笔记的主要内容是 cypher 查询语言的编写与使用。 笔记主要整理自w3cschool上的neo4j教程以及Neo4j中文网所提供的cypher中文文档,此外还包括少量从其他个人博客与官方手册中整理的内容。 注意:上面所说的”c...
    99+
    2019-02-12
    Neo4j/cypher学习笔记与学习建议
  • oracle 函数学习 Oracle10g学习系列(7)
    Oracle函数有字符函数、数学函数、日期函数和转换函数。我只了解了字符函数和数学函数。一、字符函数:lower(char)  将字符串转化为小写的格式SQL> select lo...
    99+
    2024-04-02
软考高级职称资格查询
编程网,编程工程师的家园,是目前国内优秀的开源技术社区之一,形成了由开源软件库、代码分享、资讯、协作翻译、讨论区和博客等几大频道内容,为IT开发者提供了一个发现、使用、并交流开源技术的平台。
  • 官方手机版

  • 微信公众号

  • 商务合作