swapper/0: page allocation failure: order:0, mode:0x1080020(GFP_ATOMIC), nodemask=(null)

[TMroy]

We looked into the report, but there is nothing wrong found there.
So try to stop your syncthing and docker, and see what difference will happen. You can also take a look at the process monitor
on Control Panel, that may help you to find out what is eating your memory.

[Asgaroth]

There is certainly something up, I can reproduce this with no application installed, that means, no docker installed, no syncthing container active.

However, here is an idle array, I was testing the raid replacement, and while the array is rebuilding I get the same allocation errors as previously listed in the post:

Code: Select all

# dmesg -T | grep 'Node 0 Normal free:'
[Wed Apr  8 17:25:49 2020] Node 0 Normal free:1700kB min:4316kB low:6300kB high:8284kB active_anon:355944kB inactive_anon:464948kB active_file:334952kB inactive_file:337436kB unevictable:4kB writepending:27960kB present:2097152kB managed:2013024kB mlocked:4kB kernel_stack:8384kB pagetables:21080kB bounce:0kB free_pcp:2480kB local_pcp:580kB free_cma:0kB
[Wed Apr  8 17:26:01 2020] Node 0 Normal free:1288kB min:4316kB low:6300kB high:8284kB active_anon:342360kB inactive_anon:483648kB active_file:300104kB inactive_file:371940kB unevictable:4kB writepending:44276kB present:2097152kB managed:2013024kB mlocked:4kB kernel_stack:8368kB pagetables:21080kB bounce:0kB free_pcp:544kB local_pcp:104kB free_cma:0kB
[Wed Apr  8 17:26:06 2020] Node 0 Normal free:1556kB min:4316kB low:6300kB high:8284kB active_anon:341820kB inactive_anon:484112kB active_file:300100kB inactive_file:371652kB unevictable:4kB writepending:44300kB present:2097152kB managed:2013024kB mlocked:4kB kernel_stack:8416kB pagetables:21092kB bounce:0kB free_pcp:652kB local_pcp:104kB free_cma:0kB
[Wed Apr  8 17:29:54 2020] Node 0 Normal free:1712kB min:4316kB low:6300kB high:8284kB active_anon:323396kB inactive_anon:495656kB active_file:223720kB inactive_file:455636kB unevictable:4kB writepending:4392kB present:2097152kB managed:2013024kB mlocked:4kB kernel_stack:8432kB pagetables:21356kB bounce:0kB free_pcp:2644kB local_pcp:568kB free_cma:0kB
[Wed Apr  8 17:30:33 2020] Node 0 Normal free:1568kB min:4316kB low:6300kB high:8284kB active_anon:322216kB inactive_anon:488372kB active_file:220744kB inactive_file:467680kB unevictable:4kB writepending:102636kB present:2097152kB managed:2013024kB mlocked:4kB kernel_stack:8560kB pagetables:21380kB bounce:0kB free_pcp:332kB local_pcp:72kB free_cma:0kB
[Wed Apr  8 17:30:58 2020] Node 0 Normal free:1344kB min:4316kB low:6300kB high:8284kB active_anon:324408kB inactive_anon:486976kB active_file:204920kB inactive_file:482384kB unevictable:4kB writepending:21496kB present:2097152kB managed:2013024kB mlocked:4kB kernel_stack:8520kB pagetables:21308kB bounce:0kB free_pcp:2408kB local_pcp:516kB free_cma:0kB
[Wed Apr  8 17:31:11 2020] Node 0 Normal free:1568kB min:4316kB low:6300kB high:8284kB active_anon:321828kB inactive_anon:488116kB active_file:197496kB inactive_file:491360kB unevictable:4kB writepending:24496kB present:2097152kB managed:2013024kB mlocked:4kB kernel_stack:8552kB pagetables:21328kB bounce:0kB free_pcp:1860kB local_pcp:204kB free_cma:0kB
[Wed Apr  8 17:31:16 2020] Node 0 Normal free:1216kB min:4316kB low:6300kB high:8284kB active_anon:321344kB inactive_anon:487692kB active_file:196816kB inactive_file:490748kB unevictable:4kB writepending:24504kB present:2097152kB managed:2013024kB mlocked:4kB kernel_stack:8552kB pagetables:21308kB bounce:0kB free_pcp:120kB local_pcp:120kB free_cma:0kB
[Wed Apr  8 17:31:21 2020] Node 0 Normal free:1380kB min:4316kB low:6300kB high:8284kB active_anon:320896kB inactive_anon:487472kB active_file:196076kB inactive_file:490228kB unevictable:4kB writepending:24504kB present:2097152kB managed:2013024kB mlocked:4kB kernel_stack:8552kB pagetables:21308kB bounce:0kB free_pcp:192kB local_pcp:52kB free_cma:0kB
[Wed Apr  8 17:31:29 2020] Node 0 Normal free:1228kB min:4316kB low:6300kB high:8284kB active_anon:319276kB inactive_anon:484828kB active_file:189432kB inactive_file:504144kB unevictable:4kB writepending:53336kB present:2097152kB managed:2013024kB mlocked:4kB kernel_stack:8584kB pagetables:21308kB bounce:0kB free_pcp:2348kB local_pcp:256kB free_cma:0kB

free memory at the time is 700MB, circa 1.15GB available for allocation:

Code: Select all

# free -mt
              total        used        free      shared  buff/cache   available
Mem:           3331        2173         722          14         435        1150
Swap:           976         542         434
Total:         4308        2715        1156

[TMroy]

OK, I will call an engineer to look into your case again.

[Asgaroth]

The hardware appears to be okay, I think it may just be a setting in the TOS environment somewhere.

I'm currently testing with a different OS installed, and so far I've not had any speed drops or any memory allocation errors, but I need to transfer around 5.8TB of data first so that I am doing exactly what I did on the TOS OS to see if it happens on the different OS. So far no issues encountered while transfering 1TB, still got another 4.8TB to go.

[Asgaroth]

Just an update:

Testing with different software installed yielded better results.

On the different software:
[1] I did not have any of the issues listed in this thread.
[2] Transfer speeds were way faster (roughly 28 hours to transfer 5.8TB, on TOS it took 3 days)

I think I will stay on the other software until TOS improves a little more.

[TMSupport]

Could you advise what's the other software?

[Asgaroth]

Hi, sorry for the late reply.

It is Open Media Vault (version 5), based on Debian.

There are currently only two issues I have with running this version and they are:

[1] The fan control does not work, the fans run at their lowest speed, and
[2] The LED's on the NAS are not correct, ie all drive led is solid red, however smartctl reports the drives as being okay and the network activity LED is off.

Other than that OMV runs perfectly on the F5-421.