DS Forums

 
 

Why is deleting so slow on the Foxsat?


Reply
Thread Tools Search this Thread
Old 02-10-2010, 13:39
tgabber
Forum Member
 
Join Date: Feb 2004
Location: Sunny France (sometimes)
Posts: 1,019

It's not a problem I'm just curious really, why deleting a recording on the Foxsat HDR takes several seconds.

Normally file deletes on computers are pretty instantaneous since all that actually happens is that the directory entry is removed and the relevant disk space marked as free, the data itself still exists until it gets overwritten.

The time it takes for the HDR to delete suggests that the data itself is getting deleted akin to a 'security wipe'. I can't think why this would be deemed to be necessary though, so is there another explanation?
tgabber is offline   Reply With Quote
Please sign in or register to remove this advertisement.
Old 02-10-2010, 14:35
richard_g_uk
Forum Member
 
Join Date: Nov 2003
Location: Cradley, Halesowen, W.Mids
Posts: 1,047
Normally file deletes on computers are pretty instantaneous since all that actually happens is that the directory entry is removed and the relevant disk space marked as free, the data itself still exists until it gets overwritten.
The HDR uses the UNIX filesystem. Here is a link to explain how deleting works on this filesystem:-

http://www.dataexpedition.com/~sbnob...lesystems.html

As you will see deleting is far more complex than just removing a single entry from the file allocation table.
richard_g_uk is offline   Reply With Quote
Old 02-10-2010, 15:31
tgabber
Forum Member
 
Join Date: Feb 2004
Location: Sunny France (sometimes)
Posts: 1,019
The HDR uses the UNIX filesystem. Here is a link to explain how deleting works on this filesystem:-

http://www.dataexpedition.com/~sbnob...lesystems.html

As you will see deleting is far more complex than just removing a single entry from the file allocation table.

Thanks Richard, but I'm pretty familiar with Linux and ext3, and doing 'rm <file>' or even a whole directory of files is virtually instantaneous, unless, as I said, you choose to use something like 'shred' to actually wipe the data.
tgabber is offline   Reply With Quote
Old 04-10-2010, 10:43
Bob_Cat
Forum Member
 
Join Date: Apr 2005
Location: Surrey, UK
Posts: 1,302
In the ext file system blocks that are deleted must be verified and while the HDR does this in the most economical way it does require the process to happen. Recordings are typically GB in size and as a result the CPU must spend time processing this function. It does this at low priority compared to other tasks so as reduce the impact on the broadcast reception side and as a result it takes time for a file to be deleted on the modest CPU. The product has a 400MHz MIPS single thread CPU to do all of it's functions including most of the graphics.
Bob_Cat is offline Follow this poster on Twitter   Reply With Quote
Old 04-10-2010, 13:55
Badvok
Guest
 
Join Date: Apr 2004
Posts: 957
In the ext file system blocks that are deleted must be verified ...
Any chance you can clarify what you mean by this? Are you talking about bad-block detection? If so, I'm surprised this isn't left to the disk drive itself since I believe most drives include auto-relocation/remapping of bad sectors these days.
Badvok is offline   Reply With Quote
Old 04-10-2010, 14:47
Bob_Cat
Forum Member
 
Join Date: Apr 2005
Location: Surrey, UK
Posts: 1,302
To quote Andreas Dilger one of the developers of the ext3 file system:
In order to ensure that ext3 can safely resume an unlink after a crash, it actually zeros out the block pointers in the inode, whereas ext2 just marks these blocks as unused in the block bitmaps and marks the inode as "deleted" and leaves the block pointers alone.
This is the more intensive process that takes time.

Bob
Bob_Cat is offline Follow this poster on Twitter   Reply With Quote
Old 04-10-2010, 15:01
AxeVictim
Forum Member
 
Join Date: Jul 2001
Posts: 2,644
Why cant it use the same system as Sky or even the old Humax 9200T when it was instant or at least deleted it in the background while you did something else ?
AxeVictim is offline   Reply With Quote
Old 04-10-2010, 15:08
REPASSAC
Forum Member
 
Join Date: Jun 2010
Location: Perchede, France
Posts: 1,936
Why cant it use the same system as Sky or even the old Humax 9200T when it was instant or at least deleted it in the background while you did something else ?
I think it does do it in the background - It's just that a flashing icon shows you it is happening. I think the only things you can't do is delete another file or start a file copy?
REPASSAC is offline   Reply With Quote
Old 04-10-2010, 15:45
Andrue
Forum Member
 
Join Date: Jul 2001
Location: Brackley, UK
Posts: 16,657
I think it does do it in the background - It's just that a flashing icon shows you it is happening. I think the only things you can't do is delete another file or start a file copy?
Correct. You can even drop the HDR into standby during a lengthy delete. There will be delay while it finishes then it enters standby.
Andrue is offline   Reply With Quote
Old 04-10-2010, 15:50
Andrue
Forum Member
 
Join Date: Jul 2001
Location: Brackley, UK
Posts: 16,657
To quote Andreas Dilger one of the developers of the ext3 file system:


This is the more intensive process that takes time.

Bob
I've never been a great fan of the Ext variants. The fact they don't tend use RLE for blocks annoys me.

I prefer HPFS because it uses RLE in a B+Tree but also tries to keep FNodes close to the data they describe. It made recovering data a lot more reliable.

Second best would be NTFS. I'm not keen on the centralised MFT but I like the way it encodes block allocations. I also love the way it's basically a superset of pretty much any other FS. About the only one we had to deal with that it couldn't mimic was AS400 - and that's not really a file system anyway.

But the problem with NTFS is writing it. Reading is okay but there's so much you have to get right when you're writing to it
Andrue is offline   Reply With Quote
Old 04-10-2010, 16:15
gomezz
Forum Member
 
Join Date: Oct 2004
Location: Buckingham
Posts: 28,537
This is the more intensive process that takes time.
What an extraordinary way of doing it. Surely rebuilding the free block chain on those comparatively rare occasions you need to recover is the better and more efficient way overall.
gomezz is offline   Reply With Quote
Old 05-10-2010, 10:49
Bob_Cat
Forum Member
 
Join Date: Apr 2005
Location: Surrey, UK
Posts: 1,302
Andrue,

I agree it isn't my favourite either. Apparently HQ have been doing some R&D on this subject as we head toward advanced next generation products.

Bob
Bob_Cat is offline Follow this poster on Twitter   Reply With Quote
Old 01-02-2011, 20:14
bigbri
Forum Member
 
Join Date: Aug 2004
Location: Cambs.
Posts: 114
Apologies for resurrecting an old thread. I find deleting things using the media list a bit tedious and am wondering whether deleting via FTP may be a more efficient way of doing things. Given the info above, will deleting via FTP have the same effect as deleting via the media list? I would hate to have the programs disappear but the free space not released.
bigbri is offline   Reply With Quote
Old 01-02-2011, 23:39
emdee
Forum Member
 
Join Date: Jun 2008
Posts: 62
For comparison I have just done a delete of a 2G file on a slow computer with ext3. Took 4.5 seconds including 0.5 seconds CPU time. This on a 550MHz Pentium III.

So yes, large file deletes can take a little while.
emdee is offline   Reply With Quote
 
Reply




 
Forum Jump


All times are GMT. The time now is 23:58.