Terra Photos

More about TOS 5 new features and improvements. Note: this forum is not for bug report! If you want to report bug, please go to the correct forum.
User avatar
freman
Posts: 27
Joined: 30 Nov 2021, 11:26

Re: Terra Photos

Post by freman »

This probably doesn't help

[ 304.305623] Out of memory: Kill process 9386 (mediaindex) score 752 or sacrifice child
[ 304.305650] Killed process 9386 (mediaindex) total-vm:7307936kB, anon-rss:6597112kB, file-rss:0kB, shmem-rss:0kB
[ 304.747308] oom_reaper: reaped process 9386 (mediaindex), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB

And I have the apparant maximum of 8gb of memory in this thing.
User avatar
TMSupport
TerraMaster Team
Posts: 2314
Joined: 13 Dec 2019, 15:15

Re: Terra Photos

Post by TMSupport »

{L_BUTTON_AT}freman

Please go to Control Panel - System Information - Processes to check which processes occupy high memory.
To contact our team, please send email to following addresses, remember to replace (at) with @
Technical team: support(at)terra-master.com (for technical support)
Service team: service(at)terra-master.com (for purchasing, return, replacement, RMA service)
User avatar
freman
Posts: 27
Joined: 30 Nov 2021, 11:26

Re: Terra Photos

Post by freman »

At the time it decided to kill media index this was the state of the processes on the box

Code: Select all

[  465.396103] [  pid  ]   uid  tgid total_vm      rss pgtables_bytes swapents oom_score_adj name
[  465.396120] [   2393]     0  2393     1600        6    57344       24             0 syslogd
[  465.396124] [   2396]     0  2396     2877        1    69632     1830             0 klogd
[  465.396127] [   2404]     0  2404     1074        0    49152       38             0 acpid
[  465.396131] [   2435]  1002  2435     7566        0    94208       90             0 dbus-daemon
[  465.396135] [   2857]     0  2857     3860        0    69632       41             0 udhcpc
[  465.396139] [   3165]    34  3165    63417       27   274432      212             0 postgres
[  465.396144] [   3185]    34  3185    63507       58   217088      195             0 postgres
[  465.396148] [   3186]    34  3186    63482       29   208896      222             0 postgres
[  465.396152] [   3187]    34  3187    63417       20   192512      225             0 postgres
[  465.396156] [   3188]    34  3188    16461       21   172032      225             0 postgres
[  465.396159] [   3189]    34  3189    63686       42   208896      263             0 postgres
[  465.396163] [   3251]     0  3251   142643       76   151552      183             0 upnpd
[  465.396167] [   3306]     0  3306   344789        0   188416     1778             0 regcloud
[  465.396171] [   3327]     0  3327   365031     2174   225280     1460             0 restart_service
[  465.396175] [   3457]     0  3457    98641       30    94208       14             0 syscontrol
[  465.396179] [   3740]     0  3740     8950        1   106496      377             0 nginx
[  465.396185] [   4737]     0  4737   349428     1480   233472     4288             0 ScheduledTask
[  465.396190] [   4794]  1007  4794    13100       95    86016     1160             0 redis-server
[  465.396194] [   4801]     0  4801     1252        0    57344       25             0 vmtouch
[  465.396198] [   4835]     0  4835   347222     2425   225280     1926             0 ResourceCollect
[  465.396202] [   4948]  1001  4948     8125      145   114688       47             0 avahi-daemon
[  465.396207] [   5297]    34  5297    52870       43   208896      195             0 postgres
[  465.396210] [   5429]     0  5429    16026        0   159744      279         -1000 sshd
[  465.396214] [   5555]     0  5555    88130        3   696320      790             0 smbd
[  465.396218] [   5557]     0  5557    85682       12   651264      740             0 smbd-notifyd
[  465.396223] [   5558]     0  5558    85680       10   638976      742             0 cleanupd
[  465.396227] [   5563]     0  5563    87916        0   692224      684             0 samba-bgqd
[  465.396231] [   5650]     0  5650    67195       78   520192      487             0 nmbd
[  465.396235] [   5700]     0  5700     2124       25    61440       19             0 wsdd2
[  465.396239] [   5864]     0  5864   335073     1292   266240      552             0 TerraPhotos
[  465.396243] [   5947]     0  5947   331681      940   225280      322             0 LogCenter
[  465.396247] [   6010]    34  6010    63833        4   221184      409             0 postgres
[  465.396251] [   6127]     0  6127   352053     3417   270336     5231             0 cloudSync-serve
[  465.396255] [   6256]     0  6256    35373     1012   143360      391             0 portainer
[  465.396259] [   6343]     0  6343   378257     2562   344064     1091             0 dockerd
[  465.396263] [   6356]     0  6356   327687     1200   192512     2387             0 ClamAV-amd64
[  465.396267] [   6396]     0  6396   334210     1661   258048     6656             0 Snapshot-amd64
[  465.396272] [   6400]     0  6400   349191     1481   249856      720             0 DockerApi
[  465.396276] [   6444]     0  6444    80512      441   159744      104             0 rsyslogd
[  465.396280] [   6630]     0  6630   374292     1408   303104      854             0 containerd
[  465.396284] [   6688]  1010  6688    14839       47   147456      142             0 aria2c
[  465.396288] [   6941]     0  6941    11548      120   118784      275             0 nginx
[  465.396292] [   6942]     0  6942    11548       58   118784      334             0 nginx
[  465.396296] [   6943]     0  6943    11548       57   118784      334             0 nginx
[  465.396299] [   6944]     0  6944    11614      151   118784      299             0 nginx
[  465.396303] [   7044]    34  7044    52870       91   176128      196             0 postgres
[  465.396307] [   7045]    34  7045    52870       52   184320      210             0 postgres
[  465.396311] [   7046]    34  7046    52870       34   180224      210             0 postgres
[  465.396315] [   7047]    34  7047    16461       45   163840      193             0 postgres
[  465.396319] [   7048]    34  7048    52979       53   188416      243             0 postgres
[  465.396323] [   7299]     1  7299     2710        3    69632       64             0 rpcbind
[  465.396327] [   7302]     0  7302     3319        0    65536      159             0 rpc.statd
[  465.396332] [   7326]     0  7326     5824        0    81920       89             0 rpc.idmapd
[  465.396337] [   7330]     0  7330     4396        0    73728      153             0 rpc.mountd
[  465.396341] [   7415]     0  7415   347853      983   229376     1985             0 webdav
[  465.396345] [   7480]     0  7480    34456        8   163840      198             0 netatalk
[  465.396348] [   7481]     0  7481    18454        1   172032      271             0 afpd
[  465.396352] [   7482]     0  7482    13840        0   151552      170             0 cnid_metad
[  465.396356] [   7826]     0  7826   415355     4805   393216    12481             0 TOSDaemon
[  465.396361] [   7856]     0  7856   328587     1148   217088     2213             0 ter_vg_monitor
[  465.396365] [   7992]     0  7992   331208     1587   233472     4276             0 ter_usbtool
[  465.396370] [   8055]     0  8055     1091        0    57344       25             0 vmtouch
[  465.396374] [   8057]     0  8057   370276     2298   262144     4618             0 msgcenter
[  465.396377] [   8134]     0  8134    98098       16   442368     1469             0 php-fpm
[  465.396382] [   8135]     0  8135    98098        2   421888     1482             0 php-fpm
[  465.396386] [   8136]     0  8136    98098        2   421888     1482             0 php-fpm
[  465.396389] [   8137]     0  8137    98098        2   421888     1482             0 php-fpm
[  465.396393] [   8138]     0  8138    98098        3   421888     1482             0 php-fpm
[  465.396397] [   8139]     0  8139    98098        3   421888     1482             0 php-fpm
[  465.396401] [   8142]     0  8142    10423        1   126976      311         -1000 udevd
[  465.396405] [   8442]    34  8442    63961        7   233472      454             0 postgres
[  465.396409] [   8529]     0  8529   366553     2044   229376     2590             0 nasips
[  465.396413] [   8595]     0  8595     1770       56    53248       29             0 mdadm
[  465.396417] [   8596]     0  8596     3860        0    77824       38             0 getty
[  465.396421] [   9524]     0  9524  1810599  1642528 13910016    47145             0 mediaindex
[  465.396425] [   9525]    34  9525    53420      203   221184      404             0 postgres
[  465.396429] [   9593]  1009  9593  1104498    98560  2367488   126043             0 java
[  465.396433] [  10165]     0 10165     1077       22    57344        0             0 vmtouch
[  465.396437] [  10168]     0 10168     4197       44    86016        0             0 crond
[  465.396441] [  11955]  1009 11955    30076      139   106496        0             0 controller
[  465.396446] [  12117]     0 12117   202646    77080  1097728      612             0 faceDetection
[  465.396451] [  12217]     0 12217     7530       74    73728        0             0 everyminuteexec
[  465.396455] [  12218]     0 12218     3451       68    69632        0             0 sh
[  465.396459] [  12222]     0 12222     3560      186    69632        0             0 smartctl
[  465.396462] [  12223]     0 12223     3860       40    73728        0             0 awk
[  465.396466] [  12227]     0 12227     3427       56    69632        0             0 smartctl
[  465.396470] [  12228]     0 12228     3860       37    77824        0             0 awk
[  465.396473] Out of memory: Kill process 9524 (mediaindex) score 752 or sacrifice child
[  465.396490] Killed process 9524 (mediaindex) total-vm:7242396kB, anon-rss:6570112kB, file-rss:0kB, shmem-rss:0kB
[  465.737398] oom_reaper: reaped process 9524 (mediaindex), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
That table includes memory usage.

As it stands today

Elasticsearch/java are using the most memory
Image
User avatar
TMroy
TerraMaster Team
Posts: 2578
Joined: 10 Mar 2020, 14:04
China

Re: Terra Photos

Post by TMroy »

As you said, it is out of memory. You are running too many apps, you need to close some apps and services or expand your memory capacity.
To contact our team, please send email to following addresses, remember to replace (at) with @:
Support team: support(at)terra-master.com (for technical support only)
Service team: service(at)terra-master.com (for purchasing, return, replacement, RMA service)
User avatar
freman
Posts: 27
Joined: 30 Nov 2021, 11:26

Re: Terra Photos

Post by freman »

Please take a closer look

[ 465.396103] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
[ 465.396421] [ 9524] 0 9524 1810599 1642528 13910016 47145 0 mediaindex
[ 465.396429] [ 9593] 1009 9593 1104498 98560 2367488 126043 0 java

See how much memory the golang program mediaindex is using compared to java and wouldn't elasticsearch be part of the same thing? terra photos/media indexing?

You may have a memory leak is all.
User avatar
TMroy
TerraMaster Team
Posts: 2578
Joined: 10 Mar 2020, 14:04
China

Re: Terra Photos

Post by TMroy »

The elasticsearch is a process for Terra Search. It needs some memory resources when it is enabled in the background, as soon as it works for the search task it going to take more memory. Terra Search is an app designed for business, it required at least 8GB of memory.

By the way, if you want to start a new topic, do it in a new post. In order to keep a clean post order, Posts not related to the topic will be deleted soon.
To contact our team, please send email to following addresses, remember to replace (at) with @:
Support team: support(at)terra-master.com (for technical support only)
Service team: service(at)terra-master.com (for purchasing, return, replacement, RMA service)
User avatar
freman
Posts: 27
Joined: 30 Nov 2021, 11:26

Re: Terra Photos

Post by freman »

This is entirely on topic - the topic of terra photos.

mediaindex is required for terra photos.
mediaidnex appears to have a memory leak.
my box has 8gb of ram
the only things in that process list using any memory is media index and java - and I'm not saying java is wasting memory, I'm saying compare the excessive memory usage of mediaindex to what would normally be the biggest process - java.

Bit silly you saying that terra photos is a business app

"Terra Photos is thus an ideal photo management tool for home users, photographers, and creative agencies." - https://www.terra-master.com/uk/terra-photos/
User avatar
TMroy
TerraMaster Team
Posts: 2578
Joined: 10 Mar 2020, 14:04
China

Re: Terra Photos

Post by TMroy »

{L_BUTTON_AT}freman

Please read carefully my reply, and carefully to your speech. And I would like to remind you that, if you provide wrong information to mislead other users, or if any action violates the forum rules, we will keep the right to take action against your account.
To contact our team, please send email to following addresses, remember to replace (at) with @:
Support team: support(at)terra-master.com (for technical support only)
Service team: service(at)terra-master.com (for purchasing, return, replacement, RMA service)
User avatar
freman
Posts: 27
Joined: 30 Nov 2021, 11:26

Re: Terra Photos

Post by freman »

Which information have I provided that is wrong or misleading?

The quote from your own website?

I've actually been quite polite and trying to be helpful, I'm more than happy to dig into processes and provide debugging, logs, anything you need really. I'm also happy to reverse engineer things and fix them.

Tho I have checked and it appears I was mistaken, mediaindex isn't go based, it appears to be C based, my bad I saw the terraphotos app itself was go based and made the assumption without checking that mediaindex was too - my bad.

Oh I see, you said elasticsearch was for terrasearch, cool, well, that's easy, I can remove that - still the java process for that is using less memory than terraphotos.
Post Reply