FAQ SearchLogin
Tuxera Home
View unanswered posts | View active topics It is currently Sat May 15, 2021 05:09



Post new topic Reply to topic  [ 6 posts ] 
NTFS-3G Silently (and inconsistently) corrupting data 
Author Message

Joined: Tue Sep 07, 2010 15:27
Posts: 3
Post NTFS-3G Silently (and inconsistently) corrupting data
First, let me say that I'm fairly new to Linux but not to computers. I'll be glad to help out with this where I can.

I'm running the latest version of Linux Mint which is based on Ubuntu. I've posted this in both the Ubuntu & Mint forums, but it seems like it's probably an NTFS-3G issue, so I wanted to make you aware of it in case it's currently an unknown issue.

The basic problem is, when copying a large (7.9G) file to local NTFS formatted partitions, the file doesn't always match the original (MD5 hash). I did a handful of tests, and based on the results, it appears to copy the file from the source file, write it to ext3 fine, but write it to NTFS intermittently fine.

The posts on the other forums explains it fairly well, so I'll just paste that below.

For reference, the posts on the other forums can be found here and here.

I've copied a 7.9G file multiple times, and sometimes the destination file gets corrupted. Here's what I've done:

Same for all copies - copied using: Linux Mint 9 (isadora) Kernel 2.6.32.21-generic
GNOME 2.30.2


1 (bad)
---------------------------------
Source: WinXP machine on network
Destination: 32G AData thumb drive (NTFS)
Result: Corrupt, MD5 Hash doesn't match

2 (bad)
---------------------------------
Source: WinXP machine on network
Destination: 80G USB drive (NTFS)
Result: Corrupt, MD5 Hash doesn't match

3 (good)
---------------------------------
Source: WinXP machine on network
Destination: /$HOME/temp
Result: Fine, MD5 Hash matches

4 (bad - 1st copy to Data1)
---------------------------------
Source: /$HOME/temp
Destination: Data1 Internal SATA drive (NTFS)
Result: Corrupt, MD5 Hash doesn't match

5 (good - 1st copy to Data2)
---------------------------------
Source: /$HOME/temp
Destination: Data2 Internal SATA drive (NTFS)
Result: Fine, MD5 Hash matches

6 (good - 2nd copy to Data1)
---------------------------------
Source: /$HOME/temp
Destination: Data1 Internal SATA drive (NTFS)
Result: Fine, MD5 Hash matches

7 (good - 2nd copy to Data2)
---------------------------------
Source: /$HOME/temp
Destination: Data2 Internal SATA drive (NTFS)
Result: Fine, MD5 Hash matches

8 (good - 3rd copy to Data1)
---------------------------------
Source: /$HOME/temp
Destination: Data1 Internal SATA drive (NTFS)
Result: Fine, MD5 Hash matches

So, it appears to copy from an SMB share just fine, and to its own filesystem just fine, but intermittently has trouble writing to local NTFS partitions. Writing to an SMB NTFS share is also file, which makes sense since it isn't having to talk "directly" to NTFS.

Another point to note is that there aren't just two md5 hashes (one good, one bad). There's one good, and multiple bad.

Thanks for your time, and feel free to let me know if I'm doing anything blatantly stupid.


Tue Sep 07, 2010 15:40
Profile
Tuxera CTO

Joined: Tue Nov 21, 2006 23:15
Posts: 1648
Post Re: NTFS-3G Silently (and inconsistently) corrupting data
Hi,

Do you use the latest stable NTFS-3G 2010.8.8?

Earlier releases may had issues, especially if transparent compression was used. We are not aware of any corruption issue in the latest driver.

Regards, Szaka


Tue Sep 07, 2010 21:49
Profile
NTFS-3G Lead Developer

Joined: Tue Sep 04, 2007 17:22
Posts: 1286
Post Re: NTFS-3G Silently (and inconsistently) corrupting data
Hi,

Quote:
The basic problem is, when copying a large (7.9G) file to local NTFS formatted partitions, the file doesn't always match the original (MD5 hash). I did a handful of tests, and based on the results, it appears to copy the file from the source file, write it to ext3 fine, but write it to NTFS intermittently fine.

The first thing to do is to make sure the ntfs file system is healthy. The best way is executing "chkdsk /F" on Windows.
Quote:
Same for all copies - copied using: Linux Mint 9 (isadora) Kernel 2.6.32.21-generic GNOME 2.30.2

The software whose version matters most is ntfs-3g (type "ntfs-3g --help").

Regards

Jean-Pierre


Tue Sep 07, 2010 21:56
Profile

Joined: Tue Sep 07, 2010 15:27
Posts: 3
Post Re: NTFS-3G Silently (and inconsistently) corrupting data
Just ran --help and I've got version 2010.3. Like I said, I'm new to Linux, so the version that's there is the one Mint/Ubuntu has pushed to me via updates.

I can run chkdsk /f, but I'll have to reboot into Windows to do it on the internal disks. I'll report back w/what that returns.


Tue Sep 07, 2010 22:32
Profile
Tuxera CTO

Joined: Tue Nov 21, 2006 23:15
Posts: 1648
Post Re: NTFS-3G Silently (and inconsistently) corrupting data
I did many tests with 10 GB files, there was not a single error. Actually this is the expected. If there were a serious problem then many people would report it.

It seems you have a unique issue. It may be hardware related but then you should also see it with other file systems. USB have much often hardware problem but SATA are typically quite reliable. Power supply or RAM can be the common source of the problem. Perhaps NTFS-3G high CPU usage triggers it.


Tue Sep 07, 2010 23:35
Profile

Joined: Tue Sep 07, 2010 15:27
Posts: 3
Post Re: NTFS-3G Silently (and inconsistently) corrupting data
Win Win7 ran chkdsk /f on both Data1 and Data2 drives and both reported 0 bad sectors.


Thu Sep 09, 2010 12:56
Profile
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 6 posts ] 


Who is online

Users browsing this forum: No registered users and 7 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group.
Original forum style by Vjacheslav Trushkin.