it’s GPT as far as I understand
and they tried to use
Well I’m confused now. Anyway it’s pointless to do the data recovery in this case. 5% loss and you’re dead.
1 Like
I have to agree. If the author doesn’t sure what geometry he was using, it’s impossible to suggest something.
Right now it looks as completely messed and corrupted. I have doubts that it can be recovered above 96%
2 Likes
Wasn’t changing anything in geomethry.
The 16TB HDD is NTFS with GPT mode, not MBR. (because MBR is only for up to 2TB)
First program i attempted to fix it, was TestDisks.
TestDisk couldn’t fix anything!
But TestDisk showed MBR is Ok.
How ever TestDisk said filesystem is corrupted or damaged, couldn’t read files or find MFT,
and couldn’t do anything with this.
The HDD was orginally working under Windows 7 Pro.
Where it was passed to virtual machine, where node was under Win10.
Passed only with that 14,55TB partition, where the node was.
The disconnection was made as fallowed:
Stopping the node, waiting some minute, turning the virtual Win10 off.
After this under host Win7, the disk reappeared again with files shown normally.
Then safe removal icon was clicked, and disk unmounted, because it was connected via docking station (clone device) via USB. (was working like that for 3 months, it was temporary)
And WRONG move here: i took the HDD from the docking station, while it was still power ON, and connected physically to PC. Didn’t want to power it off, because was afraid of changing disks orders under system, and under virtual machine could cause problems for rest of HDDs.
The cause is known: improper unplug from the PC (just like with power outage case)
It’s not a more mess that it was.
The screens from different programs just shows it from perspective.
None of them was able to do anything, nor even have available option to press to fix!
Only Gparted, had, BUT even ran with system-secure.org version,
shows it can’t do anything, and showes it has support for NTFS:
Geparted just shows it can’t open $MFT.
In addition i read about that ntfs 3g and tryed to instal itt or mount but no use:
leading to same conclusion, he can’t read MFT.
Great so i found a video, about fixing a RAW
indeed Windows doesn’t see a HDD under any filesystem, for windows its RAW,
just blank, just like on this video.
The program it suggests is free minitools Partition Wizard 9.
Well todays it’s ver. 12.8, i installed it, in trial of a full version,
it is a breakthrough, because it’s the only program that’s able to show what files are IN,
(just like suspected, there are some private backups)
BUT, next step “Check File System”, as advised,
it can’t pass above a certain step, and just stops,
just like an original chkdsk before PC boot.
So what, to put the HDD back on docking station?
as it is still turned ON, and try there, maybe original windows remembers something about MFT?
please never do that. They are not backward compatible.
Seems your disk is affected by influence of Win10, so you cannot (and shouldn’t) use it under w7 anymore.
Perhaps it can recognize the drive, but after usage of different tools…, I’m cleanly. not sure…
Thx for insights. How ever i was using successfully disks from Win7 host, passed to a Win10 in virtual machines for years, it always works back in win7, file system always working on Win7. Probbaly because its created under Win7 in first place.
Yes. If it has been formatted under Win10, it will use new features by default. It also uses them for the existing drives, formatted earlier (I.e. in WinXP, Win7, GParted, …), when you use this drive to store data.
So maybe Win7 has these features too, I cannot check anymore, I do not have any Win7.
Only me see there is a contradiction?
Sigh…
In that specific case you must off both systems, the VM and the host.
Unfortunately in this specific case it is much more disruptive, since the partition was shared to the VM.
GParted can work with NTFS via ntfs-3g package, which is not fully supports NTFS… So, it cannot fix anything. Especially after win10.
I have a strong feeling - it’s dead.
2 Likes
Not only You, i see too, TestDisk dissapinted me, that what it showed me, im not halucinating.
How ever im going to recover node’s data with a program that sees the files, and just repair the HDD and place the data back again, its 7th day of nodes offline, i should have 5 more days to put node online to save it! - just dont know if that will be enough time to recover, and copy it back, its 2,35TB of small files records shows.
1 Like
Have you tried to run chkdsk X: /f on this disk when connected to the source computer (to the one where it was originally connected to)?
1 Like
No. Will try maybe on source computer, but tomorrow, after i recover and secure the data before.
1 Like
I understand your willing to save the data. Maybe you should try R-Studio. It’s pretty good. But don’t expect too much. And please next time make the disk internal, if your pc doesn’t have any SATA port left then you can try PCI-SATA card, it’ll give you some SATA ports. Then use Linux where you can. I see you have technical background so it’s not hard to switch to Linux and play with KVM (since you’re familiar with VM) or Docker. It’s faster, more stable, scale up, long term…blah blah… Good luck man.
1 Like
its scanning chkdsk under win10 now, and it goes further with repairs than under Win7,
but it will take ~74h for full chkdsk as it is moving only with speed of ~7MB/s,
disk respons eis good, 1,7-2,5 ms on avg. Disk is fast, just the scan disk can’t use multiple threads to go faster i guess + 14 milions of small files over 3TB.
I saw somewhere here that SNOs can submit problems with a node,
for some additional halting (like audits?) for a node
if there are some procedures, i would like to ask for some halting for this node: 12mMKmuNMzBx5uhz9MoQU7Eddr3tN5wkyqoidoYkzKVMCAiTsrv
because the recovery is undergoing!
If There could be no more audits if possible, untill it will come online, that would be great!
1 Like
What are You talking about, stoooop.
The files are perfectly healthy, and The node was perfectly healthy for 3,5 years.
It’s just the access to partition i broke.
That’s not even funny.
Thank You, for Your advice’s.
if i make it in time, the node will be healthy for more years to come.
1 Like
I ran out of popcorn watching this thread, you guys are hilarious!
This shall be turned into a masterclass “Heavy artillery: practical advice on aiming at ones own foot”
Sorry, I don’t have anything constructive to contribute: the whole things needs to be bulldozered down to the bedrock, as there is no point in fixing this madness, and instead a new architecture needs to be implemented – without Windows, without raid controllers that are not in IT mode, and without the unnecessary VMs…
5 Likes
There is no such a thing. I do not know, where you took this.
Just try to bring it online before 30 days of offline, it could recover, if you would not have downtimes anymore for the next 30 days.
2 Likes
Oh! Thanks @Alexey, because i though i have only 12 days,
it’s been 220h of offline time now, but in 5-6 days it should be restored.
And to others, just last few words...
Great to see You having fun,
but sad to see You guys, on a forum about a storage, couldn’t come up with anything helpful beside Your comments mocking windows 7 and making things Up.
If You have to bulldozere, i guess its posts You guys made there, up above.
And IsThisOn
You guys talking about things that not exist!
for example: is a “raid controllers that are not in IT mode” are here in the room with us?
No one said anything about it.
I guess if a controller saw some disks in Windows without any RAID, as described, before connecting a disk being a subject of this thread, then it has to be in so called IT mode, or JBOD.
And why without Windows? just because You don’t like it?
Well if Linux wouldn’t been so fundamental failure in usability? despite its superiority? but just happened to be, that If You have to write something in console, in a docker, e.v.e.r.y.s.i.n.g.l.e.t.i.m.e You want to do something? then i guess, as an underpaid SNO,
“using what i have only” (in terms of my knowledge as well),
running several nodes, i don’t have time for that, sorry.
If Windows was so fundamentally bad, then why it still exists? and is a majority of market?
And why Storj did a Windows version for a node? They did, so there, i’m using it! (SHOCK right?)
And Windows 7 is best windows up to date that Microsoft was able to put together.
I would use Win7 for nodes, if that was up to me, unfortunately, storj Windows GUI requires windows10, and it’s modern services.
Windows 10 would be good, if not that it’s largely a ransomware by design, doing updates even You told him not to, and then restarts by it’s own, without asking if he can, that ignores users commands intentionally, not executing the chooses by 1st time click, and You have to click up to 3rd time the same button for it, to acknowledge that “no i don’t want new f***ing update every other day, to be installed, and ruin my work by uncontrollable restarts”.
Beside that Windows 11 is rising as a cool thing. if You cut it’s spyware functions with a “ThisIsWin11” program, but also You don’t have a choice, because it comes with pair with modern hardware, if You want to use it’s fullest potential, gotta have Win11.
But to install Win11 on hardware from Win7 era? it’s not even possible.
Beside that those motherboards from 2012-2016 are still a great stable DDR4 modern machines!
You want me to buy newer hardware just for storj node or what?
“Use what You have”?
Then i have a Win7 workstation, with Win7 era compatible hardware, are you mocking it?
because it’s not what You like? a Linux machine?
If i have a win7 pro workstation, with Win7 era hardware,
with Virtual machines(son!)
so i used that for nodes, do you mocking that?
Sorry, but don’t have anything else,
and i hate Linux for reasons mentioned above.
So the only choice i have is to choose something from the Windows family.
And Win7 is best Windows M$ did up to day.
Also i very much liked Windows Sever 2012, its the same family as Win7.
Imagine Windows 10 as a host for a workstation with multiple virtual machines,
no nightmare bigger than that to administrate.
Stable Win7, as a host is a stable host!
No restarts, no blue-screens.
Cultured and polite.
Win7 works perfectly stable on Win7 era hardware’s, obviously?
So why push some untested new Windowses on those?
Soooo overall, why to take forum space, if one have nothing helpful to say? (rhetorical, pls don’t respond oh God!
Or just pls in private, if so.
Message completed. Over and out.)
Hey man, it’s all friendly banter, no offense was intended. However, you bring up a few interesting points, and do I do love answering rhetorical questions, so…
lets go!
To summarize, before diving in, a few points were made here:
- simple is better than complex,
- The fewer layers you have between software and hard drive the better
- VMs are not adding any value for storagenode, but decimate performance (disk caches)
- NTFS is a horrible choice of the filesystem
- Windows is a horrible choice of an OS for services.
- Moving things around haphazardly hoping the magic will do it’s thing - never pays off.
- Many other questionable choices takes that we’ll gloss over, in the interest of space.
Now, detais.
That was to address using third party raid solutions. Maybe I misunderstood, but you seem to have said this:
Controllers do somethings wonderful things with the underlying raw storage. Connecting a drive to such a controller and expecting the data to survive is … brave.
First of all, your home/workstation windows license does not permit hosting services. That’s a full stop here. You need windows server license.
Next, desktop windows is optimized for applications, not services. You need to tweak it quite a bit to make it work well in server scenarios, but then see above - can’t host services anyway.
Next, administering windows server is a nightmare I wish to nobody. It’t like doing surgery wearing lead mittens. Possible, but utterly masochistic.
Yes. Me not linking it would be an understatement. But that’s not the reasons; instead, all these reasons I don’t’ like it for make it not suitable for your purposes as well. It’s a correlation, not causation.
Are we talking about end user desktop experience, or system administration experience. Because the latter is much better on unix based operating systems. The former - quite shitty on both. If you want good user expericene – buy a Mac. That said, modern gnome is quite good, and surpasses windows desktop in many ways.
For perspective on where I’m coming from: for 20 years early in my carrier I was user mode developer on windows, kernel mode developer on windows, kernel mode developer on brewOS, beOS, Windows CE, Windows Mobile, Windows Phone, Vista, and 6 generations of Android, and I have literally changed jobs because of not wanting to deal with Microsoft (and Andorra) nonsense anymore. So hell yeah, I dislike Windows.
In what tasks? most servers in the world run some flavor of linux. Most users use windows. Or maybe now chromeOS. Each tool has its place. Windows is indispensable in some corporate environments because they do a superb job maintaining obscenely log backwards compatibility. It’s just shit for prosumers.
Ehhh… yes? Because it’s much faster, because you don’t have to fight poorly designed UI and walk on eggshells around UI bugs and omissions?
Well, that means you “don’t have what’s needed” to run node. So, don’t run node. I don’t see a problem.
By trying to run a node on an unsuitable system you waste a lot of your own time that you could use more productively. How much time did you spend debugging this issue in this thread? Multiple that by minimum wage in your region, and you’ll see you wasted massive amount of money for no reason. It probably indeed would be cheaper to buy correct hardware and software.
It has its place. It is suitable for some jobs, just not this one.
By virtue of having early market dominance starting from MS-DOS, his focus on backward binary compatibility that drove corporate adoption, strong developer ecosystem, deals with OEMs to ship computers with windows by default, and heavy marketing.
None of this says anything about usability or fitness for a specific purpose.
Because there are some windows servers running idle with extra space… because most of the world moved to running services on *nix.
Right. It’s on you to check your licensing terms. You can’t hold storj responsible for poor choice of license, poor choice of hardware configuration, software configuration, etc etc. The fact that something exists does not mean that it’s a right choice for everyone.
I strongly disagree. “best” is subjective.
Furthermore, windows 7 reached end of life on January 14, 2020. You need to stop using it right away on any network connected devices.
Glad it’s not up to you.
Well, none of this is true about Windows Server 2016. You are using wrong OS for the purpose. Whose fault is this?
For home users sure, forced updates are a must. For servers – no way, the opposite is true
Just move to Mac already. Windows continuously “borrowing” and adopting macOS and gnome features. Run Mac as your desktop machine and run server software on FreeBSD. Leave windows to run Steam (until all the games you play are ported to Mac)
I’m running windows 11 (with Steam) on P8-Z68 board. Form 2012. With i7-2600k CPU. I forgot what I did to fool it into believing it has TPM, but it’s not impossible. It’s just a software restriction. There is nothing inherently that requires TPM.
Yes! This is wrong software. You need server OS. Both from licensing and performance reasons.
I.e. you don’t have a “an existing system” suitable to run storagenode!.It’s that simple.
I don’t like linux either. But this is the point. It’s because home/ws version of windows is not suitable for what you are trying to do.
Yes. It’s horrible system design choice. You are introducing VM layer where it is not needed, and sacrificed performance (disk caches are gone) reliability (storage is far removed from filesystem) and using NTFS for all that is very bad idea. I suspect that in those VM you run another windows? Which just quadruples the problems.
You did not mention any reasons beside not wanting to learn a very common unix shell. Windows also has shells (three! it’s just idiotic) but they are much harder to use. And various linux distributions have UIs that mimics windows to make it easy for windows users to break free from Stockholm syndrome.
It’s EOL, please make us all a favor and stop using it on network connected devices.
Bingo!
You mean Hyper-V? or VMWare? Hyper-V is unsupportable undebuggable piece of shit. Sorry for frankness here. If you just need host with VMs – why not use V-Sphere(exsi) or even that ProxMox? It’s all UI, no command line needed, and no messing with windows.
Dude. You have a very abusive relationship with windows. Please break free. Don’t be a slave of habit. You’ve learned windows, you’ll learned linux. Except linux experience will translate to the rest of the world, and you will be much more productive and happier.
BECAUSE IT HAS REACHED END OF LIFE. It’s not supported. No security fixes are released for it. If you continue using it on the Internet you are just waiting for it to join a botnet in the best case. Stop using it now.
To ignite (this) outrage and provide useful information in the form of a response to your rhetorical questions.
Somethings answering the question directly is very harmful.
Too late!! 
1 Like
It’s a good learning experience. I remember the time I thought I was smart enough not to type rm -rf /. Trying to recover a known-faulty setup is a good exercise to get familiar with many, many technical details—whether you are using Windows or an operating system. That said,
2 Likes