2 |
DENIED
|
moderate
|
App\Entity\Entry {#1576
+user: App\Entity\User {#265 …}
+magazine: Proxies\__CG__\App\Entity\Magazine {#1731 …}
+image: null
+domain: Proxies\__CG__\App\Entity\Domain {#1619 …}
+slug: "Linux-file-transfer-speed-bottlenecks"
+title: "Linux file transfer speed bottlenecks?"
+url: null
+body: """
I’m currently watching the progress of a 4tB rsync file transfer, and i’m curious why the speeds are less than the theoretical read/write maximum speeds of the drives involved with the transfer. I know there’s a lot that can effect transfer speeds, so I guess i’m not asking why my transfer itself isn’t going faster. I’m more just curious what the bottlenecks could be typically?\n
\n
Assuming a file transfer between 2 physical drives, and:\n
\n
- Both drives are internal SATA III drives with 5.0GB/s 5.0Gb/s read/write 210Mb/s (this was the mistake: I was reading the sata III protocol speed as the disk speed)\n
- files are being transferred using a simple rsync command\n
- there are no other processes running\n
\n
What would be the likely bottlenecks? Could the motherboard/processor likely limit the speed? The available memory? Or the file structure of the files themselves (whether they are fragmented on the volumes or not)?
"""
+type: "article"
+lang: "en"
+isOc: false
+hasEmbed: false
+commentCount: 12
+favouriteCount: 43
+score: 0
+isAdult: false
+sticky: false
+lastActive: DateTime @1729314700 {#1572
date: 2024-10-19 07:11:40.0 +02:00
}
+ip: null
+adaAmount: 0
+tags: null
+mentions: null
+comments: Doctrine\ORM\PersistentCollection {#1702 …}
+votes: Doctrine\ORM\PersistentCollection {#1683 …}
+reports: Doctrine\ORM\PersistentCollection {#1689 …}
+favourites: Doctrine\ORM\PersistentCollection {#1724 …}
+notifications: Doctrine\ORM\PersistentCollection {#1727 …}
+badges: Doctrine\ORM\PersistentCollection {#2464 …}
+children: []
-id: 33332
-titleTs: "'bottleneck':5 'file':2 'linux':1 'speed':4 'transfer':3"
-bodyTs: "'2':77 '210mb/s':94 '4tb':9 '5.0':89,91 'ask':52 'assum':72 'avail':140 'bottleneck':68,131 'command':119 'could':69,132 'curious':16,65 'current':3 'disk':109 'drive':30,79,82,87 'effect':43 'faster':60 'file':11,74,111,144,148 'fragment':153 'gb/s':90,92 'go':59 'guess':48 'iii':86,104 'intern':84 'involv':31 'isn':57 'know':36 'less':21 'like':130,135 'limit':136 'lot':40 'm':2,15,50,62 'maximum':26 'memori':141 'mistak':98 'motherboard/processor':134 'physic':78 'process':124 'progress':6 'protocol':105 'read':101 'read/write':25,93 'rsync':10,118 'run':125 'sata':85,103 'simpl':117 'speed':19,27,45,106,110,138 'structur':145 'theoret':24 'transfer':12,34,44,55,75,114 'typic':71 'use':115 'volum':156 'watch':4 'whether':150 'would':127"
+cross: false
+upVotes: 0
+downVotes: 0
+ranking: 1706394465
+visibility: "visible "
+apId: "https://midwest.social/post/7965088"
+editedAt: DateTimeImmutable @1729391389 {#1660
date: 2024-10-20 04:29:49.0 +02:00
}
+createdAt: DateTimeImmutable @1706308065 {#1587
date: 2024-01-26 23:27:45.0 +01:00
}
} |
3 |
DENIED
|
edit
|
App\Entity\Entry {#1576
+user: App\Entity\User {#265 …}
+magazine: Proxies\__CG__\App\Entity\Magazine {#1731 …}
+image: null
+domain: Proxies\__CG__\App\Entity\Domain {#1619 …}
+slug: "Linux-file-transfer-speed-bottlenecks"
+title: "Linux file transfer speed bottlenecks?"
+url: null
+body: """
I’m currently watching the progress of a 4tB rsync file transfer, and i’m curious why the speeds are less than the theoretical read/write maximum speeds of the drives involved with the transfer. I know there’s a lot that can effect transfer speeds, so I guess i’m not asking why my transfer itself isn’t going faster. I’m more just curious what the bottlenecks could be typically?\n
\n
Assuming a file transfer between 2 physical drives, and:\n
\n
- Both drives are internal SATA III drives with 5.0GB/s 5.0Gb/s read/write 210Mb/s (this was the mistake: I was reading the sata III protocol speed as the disk speed)\n
- files are being transferred using a simple rsync command\n
- there are no other processes running\n
\n
What would be the likely bottlenecks? Could the motherboard/processor likely limit the speed? The available memory? Or the file structure of the files themselves (whether they are fragmented on the volumes or not)?
"""
+type: "article"
+lang: "en"
+isOc: false
+hasEmbed: false
+commentCount: 12
+favouriteCount: 43
+score: 0
+isAdult: false
+sticky: false
+lastActive: DateTime @1729314700 {#1572
date: 2024-10-19 07:11:40.0 +02:00
}
+ip: null
+adaAmount: 0
+tags: null
+mentions: null
+comments: Doctrine\ORM\PersistentCollection {#1702 …}
+votes: Doctrine\ORM\PersistentCollection {#1683 …}
+reports: Doctrine\ORM\PersistentCollection {#1689 …}
+favourites: Doctrine\ORM\PersistentCollection {#1724 …}
+notifications: Doctrine\ORM\PersistentCollection {#1727 …}
+badges: Doctrine\ORM\PersistentCollection {#2464 …}
+children: []
-id: 33332
-titleTs: "'bottleneck':5 'file':2 'linux':1 'speed':4 'transfer':3"
-bodyTs: "'2':77 '210mb/s':94 '4tb':9 '5.0':89,91 'ask':52 'assum':72 'avail':140 'bottleneck':68,131 'command':119 'could':69,132 'curious':16,65 'current':3 'disk':109 'drive':30,79,82,87 'effect':43 'faster':60 'file':11,74,111,144,148 'fragment':153 'gb/s':90,92 'go':59 'guess':48 'iii':86,104 'intern':84 'involv':31 'isn':57 'know':36 'less':21 'like':130,135 'limit':136 'lot':40 'm':2,15,50,62 'maximum':26 'memori':141 'mistak':98 'motherboard/processor':134 'physic':78 'process':124 'progress':6 'protocol':105 'read':101 'read/write':25,93 'rsync':10,118 'run':125 'sata':85,103 'simpl':117 'speed':19,27,45,106,110,138 'structur':145 'theoret':24 'transfer':12,34,44,55,75,114 'typic':71 'use':115 'volum':156 'watch':4 'whether':150 'would':127"
+cross: false
+upVotes: 0
+downVotes: 0
+ranking: 1706394465
+visibility: "visible "
+apId: "https://midwest.social/post/7965088"
+editedAt: DateTimeImmutable @1729391389 {#1660
date: 2024-10-20 04:29:49.0 +02:00
}
+createdAt: DateTimeImmutable @1706308065 {#1587
date: 2024-01-26 23:27:45.0 +01:00
}
} |
4 |
DENIED
|
moderate
|
App\Entity\Entry {#1576
+user: App\Entity\User {#265 …}
+magazine: Proxies\__CG__\App\Entity\Magazine {#1731 …}
+image: null
+domain: Proxies\__CG__\App\Entity\Domain {#1619 …}
+slug: "Linux-file-transfer-speed-bottlenecks"
+title: "Linux file transfer speed bottlenecks?"
+url: null
+body: """
I’m currently watching the progress of a 4tB rsync file transfer, and i’m curious why the speeds are less than the theoretical read/write maximum speeds of the drives involved with the transfer. I know there’s a lot that can effect transfer speeds, so I guess i’m not asking why my transfer itself isn’t going faster. I’m more just curious what the bottlenecks could be typically?\n
\n
Assuming a file transfer between 2 physical drives, and:\n
\n
- Both drives are internal SATA III drives with 5.0GB/s 5.0Gb/s read/write 210Mb/s (this was the mistake: I was reading the sata III protocol speed as the disk speed)\n
- files are being transferred using a simple rsync command\n
- there are no other processes running\n
\n
What would be the likely bottlenecks? Could the motherboard/processor likely limit the speed? The available memory? Or the file structure of the files themselves (whether they are fragmented on the volumes or not)?
"""
+type: "article"
+lang: "en"
+isOc: false
+hasEmbed: false
+commentCount: 12
+favouriteCount: 43
+score: 0
+isAdult: false
+sticky: false
+lastActive: DateTime @1729314700 {#1572
date: 2024-10-19 07:11:40.0 +02:00
}
+ip: null
+adaAmount: 0
+tags: null
+mentions: null
+comments: Doctrine\ORM\PersistentCollection {#1702 …}
+votes: Doctrine\ORM\PersistentCollection {#1683 …}
+reports: Doctrine\ORM\PersistentCollection {#1689 …}
+favourites: Doctrine\ORM\PersistentCollection {#1724 …}
+notifications: Doctrine\ORM\PersistentCollection {#1727 …}
+badges: Doctrine\ORM\PersistentCollection {#2464 …}
+children: []
-id: 33332
-titleTs: "'bottleneck':5 'file':2 'linux':1 'speed':4 'transfer':3"
-bodyTs: "'2':77 '210mb/s':94 '4tb':9 '5.0':89,91 'ask':52 'assum':72 'avail':140 'bottleneck':68,131 'command':119 'could':69,132 'curious':16,65 'current':3 'disk':109 'drive':30,79,82,87 'effect':43 'faster':60 'file':11,74,111,144,148 'fragment':153 'gb/s':90,92 'go':59 'guess':48 'iii':86,104 'intern':84 'involv':31 'isn':57 'know':36 'less':21 'like':130,135 'limit':136 'lot':40 'm':2,15,50,62 'maximum':26 'memori':141 'mistak':98 'motherboard/processor':134 'physic':78 'process':124 'progress':6 'protocol':105 'read':101 'read/write':25,93 'rsync':10,118 'run':125 'sata':85,103 'simpl':117 'speed':19,27,45,106,110,138 'structur':145 'theoret':24 'transfer':12,34,44,55,75,114 'typic':71 'use':115 'volum':156 'watch':4 'whether':150 'would':127"
+cross: false
+upVotes: 0
+downVotes: 0
+ranking: 1706394465
+visibility: "visible "
+apId: "https://midwest.social/post/7965088"
+editedAt: DateTimeImmutable @1729391389 {#1660
date: 2024-10-20 04:29:49.0 +02:00
}
+createdAt: DateTimeImmutable @1706308065 {#1587
date: 2024-01-26 23:27:45.0 +01:00
}
} |