Unable to copy dot files from external source, using smb

SMB, NFS, AFP, FTP, web file manager and Rsync server.
User avatar
V8Triker
Posts: 82
Joined: 26 Feb 2021, 19:18
Great Britain

Unable to copy dot files from external source, using smb

Post by V8Triker »

Following on from the unable to see dot files - viewtopic.php?f=24&t=598&p=2571 - it would seem that you can not copy a dot file over smb, from an external server.

I am using rsync to backup from an ubuntu server to my TNAS, but the copying of any file that starts with a dot fails
EG:
rsync: mkstemp "/media/tnas_backup/ServerFolders/Home/DannyHome/XperiaZ1 backup/Edited/._20160303_175932.JPG.2FMztw" failed: No such file or directory (2)

Can you please stop hiding/restricting dot files, or at least provide the option to give us the choice?
Bikers know why dogs stick their head out the window.

TNAS F5-221
TOS 4.2.39-2203011626
3X WD RED PLUS 3TB (RAID5)
2X WD Green 2TB (RAID1)
1X WD 4TB USB
User avatar
TMRyan
TerraMaster Team
Posts: 817
Joined: 01 Dec 2020, 11:50

Re: Unable to copy dot files from external source, using smb

Post by TMRyan »

{L_BUTTON_AT}V8Triker
Hi,
Have you tried to add a parameter to specify a temporary directory in the command?
To contact our team, please send email to following addresses, remember to replace (at) with @
Technical team: support(at)terra-master.com (for technical support)
Service team: service(at)terra-master.com (for purchasing, return, replacement)
User avatar
V8Triker
Posts: 82
Joined: 26 Feb 2021, 19:18
Great Britain

Re: Unable to copy dot files from external source, using smb

Post by V8Triker »

Thanks for you reply, but I am not sure how that will help. Or, what you mean.

Even trying to create the file from a mount point, on the Ubuntu server, does not work if the file name starts with a dot.

Code: Select all

root@bubble:/media/tnas/ServerFolders/test# echo 'The test of nothing' >._ demo.txt
-bash: ._: No such file or directory
root@bubble:/media/tnas/ServerFolders/test#
root@bubble:/media/tnas/ServerFolders/test#
root@bubble:/media/tnas/ServerFolders/test#
root@bubble:/media/tnas/ServerFolders/test#
root@bubble:/media/tnas/ServerFolders/test# echo 'The test of nothing' >demo.txt
root@bubble:/media/tnas/ServerFolders/test#
root@bubble:/media/tnas/ServerFolders/test#
root@bubble:/media/tnas/ServerFolders/test#
root@bubble:/media/tnas/ServerFolders/test#
root@bubble:/media/tnas/ServerFolders/test# ls
 demo.txt   dir1  'Test document.txt'
root@bubble:/media/tnas/ServerFolders/test#
Bikers know why dogs stick their head out the window.

TNAS F5-221
TOS 4.2.39-2203011626
3X WD RED PLUS 3TB (RAID5)
2X WD Green 2TB (RAID1)
1X WD 4TB USB
User avatar
V8Triker
Posts: 82
Joined: 26 Feb 2021, 19:18
Great Britain

Re: Unable to copy dot files from external source, using smb

Post by V8Triker »

I think the root cause is that the manipulation of the file (create, copy, etc) can not be confirmed because of the fundamental issue that it is not possible to "see" files beginning with a dot.

You can only find a file starting with a dot, on the TNAS web interface, if you know where and what to search for. To be honest, that is just STUPID!
2021-09-01 14_24_17-Window.png
Yet when I list the files, from the Ubuntu server, the dot file is not seen
2021-09-01 14_26_05-Window.png
2021-09-01 14_26_05-Window.png (7.71 KiB) Viewed 12896 times
Bikers know why dogs stick their head out the window.

TNAS F5-221
TOS 4.2.39-2203011626
3X WD RED PLUS 3TB (RAID5)
2X WD Green 2TB (RAID1)
1X WD 4TB USB
User avatar
TMroy
TerraMaster Team
Posts: 2578
Joined: 10 Mar 2020, 14:04
China

Re: Unable to copy dot files from external source, using smb

Post by TMroy »

Not offended, just curious. Files start with dot are hidden by system default. why you are fighting so hard to get the files start with dot seen? what is the meaning of that?
To contact our team, please send email to following addresses, remember to replace (at) with @:
Support team: support(at)terra-master.com (for technical support only)
Service team: service(at)terra-master.com (for purchasing, return, replacement, RMA service)
User avatar
V8Triker
Posts: 82
Joined: 26 Feb 2021, 19:18
Great Britain

Re: Unable to copy dot files from external source, using smb

Post by V8Triker »

An even easier question - "Why do you try so hard to hide them?" :D

I did mention the reason.

I am backing up the Home directories on my Ubuntu server to the TNAS
I would expect a backup to back up EVERY file.
At the moment, the configuration of the TNAS OS stops files starting with a dot from being backed up.

This means my backup solution is a failure!!
Bikers know why dogs stick their head out the window.

TNAS F5-221
TOS 4.2.39-2203011626
3X WD RED PLUS 3TB (RAID5)
2X WD Green 2TB (RAID1)
1X WD 4TB USB
User avatar
TMroy
TerraMaster Team
Posts: 2578
Joined: 10 Mar 2020, 14:04
China

Re: Unable to copy dot files from external source, using smb

Post by TMroy »

Try the Centralized Backup app instead, which may fit your need.
To contact our team, please send email to following addresses, remember to replace (at) with @:
Support team: support(at)terra-master.com (for technical support only)
Service team: service(at)terra-master.com (for purchasing, return, replacement, RMA service)
User avatar
V8Triker
Posts: 82
Joined: 26 Feb 2021, 19:18
Great Britain

Re: Unable to copy dot files from external source, using smb

Post by V8Triker »

Thanks for your reply, but again it is not relevant.

The TNAS Backup app is to backup from TNAS to an Rsync server.
2021-09-01 18_06_13-Window.png
2021-09-01 18_06_13-Window.png (20.55 KiB) Viewed 12882 times
I am backing up to the TNAS

Like I said, if the TNAS Operating System will not allow a dot file to be "seen", then any solution will not work.

Even if it did work, how would I know the backup worked without searching the source for all dot files, and then searching for them all individually on the TNAS to either confirm they exist (have been backed up) or restore them?

The only possible solution, I can think of, is to zip the source before I back it up.
But this not viable because, firstly there is terabytes of data, and secondly it makes a mockery of only transferring changed files to the backup server.

Maybe I will look for a backup solution, other than rsync, that I can run on the Ubuntu server, that does write individual files.
Something like Duplicity.

Or, maybe TerraMaster can stop hiding dot files, please.
Bikers know why dogs stick their head out the window.

TNAS F5-221
TOS 4.2.39-2203011626
3X WD RED PLUS 3TB (RAID5)
2X WD Green 2TB (RAID1)
1X WD 4TB USB
User avatar
leonardalen
Posts: 1
Joined: 05 Nov 2021, 02:04

Re: Unable to copy dot files from external source, using smb

Post by leonardalen »

Same problem here, ".digikam.mysql" folder was not synced with the same error to the Samba external storage.

I had the hide dot files = No already setup and I would bet it used to work (maybe the files got not synced, however I have not seen a sync error until today).

The problem got resolved by activating the option show hidden files in Nexctloud WebUI in Settings for External Storage.

I do not recall if the option has always been there or not.
User avatar
parveen7ghjsingh
Posts: 2
Joined: 11 Nov 2021, 18:35

Re: Unable to copy dot files from external source, using smb

Post by parveen7ghjsingh »

At the moment, the configuration of the TNAS OS stops files starting with a dot from being backed up.
Locked