Author Topic: Verify Freezes  (Read 1635 times)

Offline aethernavale

  • Newbie
  • *
  • Posts: 3
  • Karma: +0/-0
    • View Profile
Verify Freezes
« on: August 02, 2012, 06:18:20 pm »
Hello all.

New to FlexRAID, was previously using an Areca hardware raid controller with battery backup module but I didn't want to spend the heaps of money required to upgrade that when I decided to go for more drives in a new setup.

I've managed to setup everything, and have performed updates, quick validates, and validates successfully without issue. However, I am unable to successfully complete a verify operation.

[2012-08-02 09:53:38,663] INFO : [verify] started at: Thu Aug 02 09:53:38 MST 2012
[2012-08-02 09:53:39,240] INFO : Using RAID engine Tx
[2012-08-02 09:53:39,245] INFO : Starting verify at: 0 - Number of bytes: 1996924911616
[2012-08-02 15:49:17,648] ERROR: Invalid state - reading=false removing=false writing=false needsWriting=false computing=true needsComputing=true
java.io.IOException: Invalid state - reading=false removing=false writing=false needsWriting=false computing=true needsComputing=true
   at java.lang.Void.<unknown>(Unknown Source)
   at java.lang.Void.<unknown>(Unknown Source)
   at java.lang.Void.<unknown>(Unknown Source)
   at java.lang.Void.<unknown>(Unknown Source)
[2012-08-02 15:49:17,648] INFO : Verify failure: operation aborted!
[2012-08-02 15:49:17,649] INFO : [verify] completed at: Thu Aug 02 15:49:17 MST 2012
[2012-08-02 15:49:17,709] WARN : Memory leak detected on native buffers! Leaks count = 36 out of 48

This was my latest attempt. They all fail in a similar, if not the exact same fashion.

They always occur at around 5 hrs and 45 minutes into the verify, at exactly (always) 70% completion. The FlexRaid service halts when this error occurs, and the array goes offline, with "com.google.gwt.user.client.rpc.StatusCodeException 0" errors showing up in the browser window if any operation is requested - most likely a symptom of the service dying and not of the actual issue (given what that status code means).

The array is an Infinity engine Snapraid setup, with 18 DRUs and 3 PPUs (was supposed to be 19 DRU but one had to be RMAd. Still waiting on replacement drive). The drives themselves were checked with SeaTools prior to use in the array, and are the F4 2TB model with latest firmware updates. The computer itself is running on Win 7 x64 Ultimate.

I can provide further information about system specs as needed.

Offline frason

  • Jr. Member
  • **
  • Posts: 57
  • Karma: +1/-0
    • View Profile
Re: Verify Freezes
« Reply #1 on: August 03, 2012, 02:51:50 am »

Offline aethernavale

  • Newbie
  • *
  • Posts: 3
  • Karma: +0/-0
    • View Profile
Re: Verify Freezes
« Reply #2 on: August 03, 2012, 10:56:28 am »
Turning on the verbose logging option does not appear to display any additional information about the error.

Code: [Select]
[2012-08-03 07:11:31,159] TRACE: Processing C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\iTunes Library\Music\The Letter Black\Hanging On By a Thread\04 Believe.m4a
[2012-08-03 07:11:31,164] TRACE: Processing C:\FlexRAID-Managed-Pool\class1_0\{8882abbd-59f1-405b-a547-64bce871bdcb}\Media Library\Movies\House\Season04_Disc03.iso
[2012-08-03 07:11:31,407] TRACE: Processing C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\iTunes Library\Music\Theory of a Deadman\Gasoline\08 Hello Lonely (Walk Away from This.m4a
[2012-08-03 07:11:31,639] TRACE: Processing C:\FlexRAID-Managed-Pool\class1_0\{35374411-95af-4ea1-a84d-167c711884c4}\001309.flxr
[2012-08-03 07:11:31,639] TRACE: Processing C:\FlexRAID-Managed-Pool\class1_0\{fb2e5cbd-7b15-49b0-8255-c5f14530a5da}\001309.flxr
[2012-08-03 07:11:31,639] TRACE: Processing C:\FlexRAID-Managed-Pool\class1_0\{631cbcda-f7d6-45c0-8bac-a79a200f352f}\001309.flxr
[2012-08-03 07:11:31,767] TRACE: Processing C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\iTunes Library\Music\3 Doors Down\When You're Young - Single\01 When You're Young.m4a
[2012-08-03 07:11:32,094] TRACE: Processing C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\iTunes Library\Music\Tarja\What Lies Beneath (Deluxe)\1-06 Rivers of Lust.m4a
[2012-08-03 07:11:32,294] ERROR: Invalid state - reading=false removing=false writing=false needsWriting=false computing=true needsComputing=true
java.io.IOException: Invalid state - reading=false removing=false writing=false needsWriting=false computing=true needsComputing=true
at java.lang.Void.<unknown>(Unknown Source)
at java.lang.Void.<unknown>(Unknown Source)
at java.lang.Void.<unknown>(Unknown Source)
at java.lang.Void.<unknown>(Unknown Source)
[2012-08-03 07:11:32,295] INFO : Verify failure: operation aborted!
[2012-08-03 07:11:32,295] INFO : [verify] completed at: Fri Aug 03 07:11:32 MST 2012
[2012-08-03 07:11:32,334] WARN : Memory leak detected on native buffers! Leaks count = 36 out of 48

All it appears to show is which files are being opened / checked when. I checked the files listed before the error and they are not corrupt, so...

Here's the low level log, didn't see anything useful but -

Code: [Select]
--------------- Storage Pool Start ---------------
[2012-8-3 8:12:31.579858][1124][Mounting Storage Pool]
[2012-8-3 8:12:31.579858][1124][VM already acquired...]
[2012-8-3 8:12:31.579859][1124][Setting handler...]
[2012-8-3 8:12:31.579859][1124][Initializing IDs...]
[2012-8-3 8:12:31.579859][1124][InitCommonIDs]
[2012-8-3 8:12:31.579859][1124][InitCommonIDs] Done
[2012-8-3 8:12:31.579859][1124][InitWinIDs]
[2012-8-3 8:12:31.579859][1124][InitWinIDs] Done
[2012-8-3 8:12:31.579859][1124][InitOSIDs]
[2012-8-3 8:12:31.579859][1124][InitOSIDs] Done
[2012-8-3 8:12:31.579859][1124][Reading live options...]
[2012-8-3 8:12:31.579859][1124][Reading user options...]
[2012-8-3 8:12:31.579860][1124][Building security...]
[2012-8-3 8:12:31.579860][1124][Building options...]
[2012-8-3 8:12:31.579860][1124][GUID: 842CF6CE-B3E2-4fd9-8efD-E28sL84FDS80]
[2012-8-3 8:12:31.581866][1124][OnMount]
[2012-8-3 8:12:31.581867][1124] [OnMount] => Exited...
[2012-8-3 8:12:31.591900][268][OnGetVolumeId]
[2012-8-3 8:12:31.591900][268] [OnGetVolumeId] => Exited...
[2012-8-3 8:12:31.593906][268][OnOpenFile] \
[2012-8-3 8:12:31.593906][268] [OnOpenFile] \ -> \\?\C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73} - access=1048576, mode=0
[2012-8-3 8:12:31.593906][268] [OnOpenFile] (handle=1456) => Exited...
[2012-8-3 8:12:31.593906][4352][OnCloseFile] \ (handle=1456)
[2012-8-3 8:12:31.593907][4352] [OnCloseFile] (handle=1456) => Exited...
[2012-8-3 8:44:33.305167][2092][OnOpenFile] \
[2012-8-3 8:44:33.305167][2092] [OnOpenFile] \ -> \\?\C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73} - access=32, mode=3
[2012-8-3 8:44:33.306170][2092] [OnOpenFile] (handle=1720) => Exited...
[2012-8-3 8:44:47.370070][2952][OnOpenFile] \iTunes Library
[2012-8-3 8:44:47.370070][2952] [OnOpenFile] \iTunes Library -> \\?\C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\iTunes Library - access=1048704, mode=0
[2012-8-3 8:44:47.370071][2952] [OnOpenFile] (handle=1040) => Exited...
[2012-8-3 8:44:47.370072][2092][OnOpenFile] \Media Library
[2012-8-3 8:44:47.370072][2092] [OnOpenFile] \Media Library -> \\?\C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\Media Library - access=1048704, mode=0
[2012-8-3 8:44:47.370072][2092] [OnOpenFile] (handle=1416) => Exited...
[2012-8-3 8:44:47.371075][2952][OnOpenFile] \Data Library
[2012-8-3 8:44:47.372075][2952] [OnOpenFile] \Data Library -> \\?\C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\Data Library - access=1048704, mode=0
[2012-8-3 8:44:47.372076][2952] [OnOpenFile] (handle=1084) => Exited...
[2012-8-3 8:44:47.384118][268][OnCloseFile] \iTunes Library (handle=1040)
[2012-8-3 8:44:47.384118][268] [OnCloseFile] (handle=1040) => Exited...
[2012-8-3 8:44:47.385121][4352][OnOpenFile] \iTunes Library
[2012-8-3 8:44:47.385121][4352] [OnOpenFile] \iTunes Library -> \\?\C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\iTunes Library - access=1048704, mode=0
[2012-8-3 8:44:47.385122][4352] [OnOpenFile] (handle=1240) => Exited...
[2012-8-3 8:44:47.396158][2952][OnCloseFile] \Media Library (handle=1416)
[2012-8-3 8:44:47.397159][2952] [OnCloseFile] (handle=1416) => Exited...
[2012-8-3 8:44:47.397162][2092][OnOpenFile] \Media Library
[2012-8-3 8:44:47.398162][2092] [OnOpenFile] \Media Library -> \\?\C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\Media Library - access=1048704, mode=0
[2012-8-3 8:44:47.398162][2092] [OnOpenFile] (handle=1416) => Exited...
[2012-8-3 8:44:47.406189][4352][OnCloseFile] \Data Library (handle=1084)
[2012-8-3 8:44:47.406189][4352] [OnCloseFile] (handle=1084) => Exited...
[2012-8-3 8:44:47.407192][268][OnOpenFile] \Data Library
[2012-8-3 8:44:47.407192][268] [OnOpenFile] \Data Library -> \\?\C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\Data Library - access=1048704, mode=0
[2012-8-3 8:44:47.407192][268] [OnOpenFile] (handle=1040) => Exited...
[2012-8-3 8:44:47.415220][2092][OnCloseFile] \iTunes Library (handle=1240)
[2012-8-3 8:44:47.415220][2092] [OnCloseFile] (handle=1240) => Exited...
[2012-8-3 8:44:47.425251][4352][OnCloseFile] \Media Library (handle=1416)
[2012-8-3 8:44:47.425252][4352] [OnCloseFile] (handle=1416) => Exited...
[2012-8-3 8:44:47.434282][2952][OnCloseFile] \Data Library (handle=1040)
[2012-8-3 8:44:47.434283][2952] [OnCloseFile] (handle=1040) => Exited...
[2012-8-3 9:15:16.704086][268][OnOpenFile] \iTunes Library
[2012-8-3 9:15:16.704086][268] [OnOpenFile] \iTunes Library -> \\?\C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\iTunes Library - access=1048704, mode=0
[2012-8-3 9:15:16.704087][268] [OnOpenFile] (handle=1704) => Exited...
[2012-8-3 9:15:16.704087][4352][OnOpenFile] \Media Library
[2012-8-3 9:15:16.704088][4352] [OnOpenFile] \Media Library -> \\?\C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\Media Library - access=1048704, mode=0
[2012-8-3 9:15:16.705089][4352] [OnOpenFile] (handle=1768) => Exited...
[2012-8-3 9:15:16.705091][2952][OnOpenFile] \Data Library
[2012-8-3 9:15:16.705091][2952] [OnOpenFile] \Data Library -> \\?\C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\Data Library - access=1048704, mode=0
[2012-8-3 9:15:16.705092][2952] [OnOpenFile] (handle=472) => Exited...
[2012-8-3 9:15:16.718132][2092][OnCloseFile] \iTunes Library (handle=1704)
[2012-8-3 9:15:16.718132][2092] [OnCloseFile] (handle=1704) => Exited...
[2012-8-3 9:15:16.719136][4060][OnOpenFile] \iTunes Library
[2012-8-3 9:15:16.719136][4060] [OnOpenFile] \iTunes Library -> \\?\C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\iTunes Library - access=1048704, mode=0
[2012-8-3 9:15:16.719137][4060] [OnOpenFile] (handle=1704) => Exited...
[2012-8-3 9:15:16.726160][2952][OnCloseFile] \Media Library (handle=1768)
[2012-8-3 9:15:16.726160][2952] [OnCloseFile] (handle=1768) => Exited...
[2012-8-3 9:15:16.734185][4352][OnOpenFile] \Media Library
[2012-8-3 9:15:16.734186][4352] [OnOpenFile] \Media Library -> \\?\C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\Media Library - access=1048704, mode=0
[2012-8-3 9:15:16.734186][4352] [OnOpenFile] (handle=1736) => Exited...
[2012-8-3 9:15:16.736193][4060][OnCloseFile] \Data Library (handle=472)
[2012-8-3 9:15:16.736193][4060] [OnCloseFile] (handle=472) => Exited...
[2012-8-3 9:15:16.737197][2092][OnOpenFile] \Data Library
[2012-8-3 9:15:16.737197][2092] [OnOpenFile] \Data Library -> \\?\C:\FlexRAID-Managed-Pool\class1_0\{cc51c624-6d96-496b-a356-8d5082486a73}\Data Library - access=1048704, mode=0
[2012-8-3 9:15:16.737197][2092] [OnOpenFile] (handle=1752) => Exited...
[2012-8-3 9:15:16.748233][4352][OnCloseFile] \iTunes Library (handle=1704)
[2012-8-3 9:15:16.748233][4352] [OnCloseFile] (handle=1704) => Exited...
[2012-8-3 9:15:16.758265][4060][OnCloseFile] \Media Library (handle=1736)
[2012-8-3 9:15:16.758265][4060] [OnCloseFile] (handle=1736) => Exited...
[2012-8-3 9:15:16.769302][2952][OnCloseFile] \Data Library (handle=1752)
[2012-8-3 9:15:16.769302][2952] [OnCloseFile] (handle=1752) => Exited...
[2012-8-3 14:11:32.391506][4036][DLL_PROCESS_DETACH] ID=4036

Offline aethernavale

  • Newbie
  • *
  • Posts: 3
  • Karma: +0/-0
    • View Profile
Re: Verify Freezes
« Reply #3 on: August 10, 2012, 09:37:28 am »
Still no clue on what could be causing this loss of functionality?

Offline Brahim

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 8,547
  • Karma: +204/-16
    • View Profile
Re: Verify Freezes
« Reply #4 on: August 11, 2012, 11:28:04 am »
Still no clue on what could be causing this loss of functionality?

Did you try re-creating the RAID?
If not, please do that.
If you continue to have issues please zip and attach the full FlexRAID.log file.