Everything crashes while indexing document contents (Fatal error: out of memory)

Discussion related to "Everything" 1.5 Alpha.
Post Reply
user123
Posts: 28
Joined: Sat Jan 23, 2021 4:16 pm

Everything crashes while indexing document contents (Fatal error: out of memory)

Post by user123 »

Version 1.5.0.1313a (x64)

This program is consuming extreme amounts of resources at once to the point it crashes if document size is set larger than 10 MB and I used only certain folder for indexing. Possible memory leak?

Everything consumed around 11 GB of RAM and 70% of CPU before crashing.
Image

Error message appeared too quickly for me to post it here.. And I can't find any Everything .log files.
It was something about fatal and memory. Screen recorder crashed as well so I couldn't capture the error message.

EDIT:
Found option of debug-log
So here is the log file
2022-05-15 01:27:07.524: PIPE READ 8
2022-05-15 01:27:07.524: PIPE READ 4
2022-05-15 01:27:07.524: PIPE READ 3 12
2022-05-15 01:27:07.524: update m 0 000000000abcde80
2022-05-15 01:27:07.524: PIPE READ 8
2022-05-15 01:27:07.525: update index C:
2022-05-15 01:27:07.525: PIPE WRITE 34 52
2022-05-15 01:27:07.525: PIPE READ 8
2022-05-15 01:27:07.525: PIPE READ 1520
2022-05-15 01:27:07.525: PIPE READ 0 1528
2022-05-15 01:27:07.525: USN CLOSE DATA_EXTEND CREATE fea82fed-83ad-4230-a59d-ffc7ae112c46.tmp
2022-05-15 01:27:07.525: USN BASIC_INFO_CHANGE fea82fed-83ad-4230-a59d-ffc7ae112c46.tmp
2022-05-15 01:27:07.525: PIPE READ 8
2022-05-15 01:27:07.525: USN BASIC_INFO_CHANGE SECURITY_CHANGE fea82fed-83ad-4230-a59d-ffc7ae112c46.tmp
2022-05-15 01:27:07.525: USN CREATE Preferences~RF1ae1aeb1.TMP
2022-05-15 01:27:07.525: USN CLOSE CREATE Preferences~RF1ae1aeb1.TMP
2022-05-15 01:27:07.525: USN CLOSE DELETE Preferences~RF1ae1aeb1.TMP
2022-05-15 01:27:07.525: USN RENAME_OLD_NAME Preferences
2022-05-15 01:27:07.525: USN RENAME_NEW_NAME Preferences~RF1ae1aeb1.TMP
2022-05-15 01:27:07.525: USN BASIC_INFO_CHANGE SECURITY_CHANGE RENAME_OLD_NAME fea82fed-83ad-4230-a59d-ffc7ae112c46.tmp
2022-05-15 01:27:07.525: USN BASIC_INFO_CHANGE SECURITY_CHANGE RENAME_NEW_NAME Preferences
2022-05-15 01:27:07.525: USN CLOSE RENAME_NEW_NAME Preferences~RF1ae1aeb1.TMP
2022-05-15 01:27:07.525: USN BASIC_INFO_CHANGE CLOSE SECURITY_CHANGE RENAME_NEW_NAME Preferences
2022-05-15 01:27:07.525: USN CLOSE DELETE Preferences~RF1ae1aeb1.TMP
2022-05-15 01:27:07.525: PIPE WRITE 34 52
2022-05-15 01:27:07.525: PIPE READ 8
2022-05-15 01:27:07.525: PIPE READ 8
2022-05-15 01:27:07.525: PIPE READ 0 16
2022-05-15 01:27:07.526: read usn journal C: in 0.000884 seconds
2022-05-15 01:27:07.526: PIPE WRITE 35 20
2022-05-15 01:27:07.526: PIPE READ 8
2022-05-15 01:27:07.526: PIPE READ 8
2022-05-15 01:27:07.526: PIPE READ 71
2022-05-15 01:27:07.526: PIPE READ 0 79
2022-05-15 01:27:07.526: PIPE WRITE 35 20
2022-05-15 01:27:07.526: PIPE READ 8
2022-05-15 01:27:07.526: PIPE READ 8
2022-05-15 01:27:07.526: PIPE READ 63
2022-05-15 01:27:07.526: PIPE READ 0 71
2022-05-15 01:27:07.526: PIPE WRITE 35 20
2022-05-15 01:27:07.526: PIPE READ 8
2022-05-15 01:27:07.526: PIPE READ 8
2022-05-15 01:27:07.526: PIPE READ 4
2022-05-15 01:27:07.526: PIPE READ 2 12
2022-05-15 01:27:07.526: PIPE WRITE 35 20
2022-05-15 01:27:07.526: PIPE READ 8
2022-05-15 01:27:07.526: PIPE READ 8
2022-05-15 01:27:07.526: PIPE READ 4
2022-05-15 01:27:07.526: PIPE READ 2 12
2022-05-15 01:27:07.526: PIPE READ 8
2022-05-15 01:27:07.526: updated C: in 0.000748 seconds
2022-05-15 01:27:07.526: resume ntfs monitor 0
2022-05-15 01:27:07.526: PIPE WRITE 33 52
2022-05-15 01:27:07.526: PIPE READ 8
2022-05-15 01:27:07.526: PIPE READ 0 8
2022-05-15 01:27:07.527: DB_WAIT: _db_journal_notification_event_proc waiting for _db_monitor_ntfs_process_fd_update_events_thread_proc...
2022-05-15 01:27:07.527: PIPE READ 8
2022-05-15 01:27:07.527: processed 1 usn records in 0.000088 seconds
2022-05-15 01:27:07.527: DB_WAIT: _db_journal_notification_event_proc waited 0.000140 seconds
2022-05-15 01:27:07.527: processed 11 usn records in 0.000146 seconds
2022-05-15 01:27:07.527: DB_WAIT: _db_monitor_process_fd_update_event_finished_event_proc waiting for _db_monitor_ntfs_process_fd_update_events_thread_proc...
2022-05-15 01:27:07.527: DB_WAIT: _db_monitor_process_fd_update_event_finished_event_proc waited 0.000018 seconds
2022-05-15 01:27:08.381: new results 2461212
2022-05-15 01:27:08.388: ui->listview_was_focus_in_view 0
2022-05-15 01:27:09.372: new results 2461212
2022-05-15 01:27:09.377: ui->listview_was_focus_in_view 0
2022-05-15 01:27:10.368: new results 2461212
2022-05-15 01:27:10.373: ui->listview_was_focus_in_view 0
2022-05-15 01:27:10.538: PIPE READ 8
2022-05-15 01:27:10.538: PIPE READ 4
2022-05-15 01:27:10.538: PIPE READ 3 12
2022-05-15 01:27:10.538: update m 0 000000000abcde80
2022-05-15 01:27:10.538: PIPE READ 8
2022-05-15 01:27:10.538: update index C:
2022-05-15 01:27:10.538: PIPE WRITE 34 52
2022-05-15 01:27:10.538: PIPE READ 8
2022-05-15 01:27:10.538: PIPE READ 152
2022-05-15 01:27:10.538: PIPE READ 0 160
2022-05-15 01:27:10.538: USN CREATE a69644d3-8ff8-4c87-b672-270d253fcf48.tmp
2022-05-15 01:27:10.538: PIPE READ 8
2022-05-15 01:27:10.538: PIPE WRITE 34 52
2022-05-15 01:27:10.538: PIPE READ 8
2022-05-15 01:27:10.538: PIPE READ 8
2022-05-15 01:27:10.538: PIPE READ 0 16
2022-05-15 01:27:10.539: read usn journal C: in 0.000415 seconds
2022-05-15 01:27:10.539: PIPE WRITE 35 20
2022-05-15 01:27:10.539: PIPE READ 8
2022-05-15 01:27:10.539: PIPE READ 8
2022-05-15 01:27:10.539: PIPE READ 129
2022-05-15 01:27:10.539: PIPE READ 0 137
2022-05-15 01:27:10.539: PIPE WRITE 35 20
2022-05-15 01:27:10.539: PIPE READ 8
2022-05-15 01:27:10.539: PIPE READ 8
2022-05-15 01:27:10.539: PIPE READ 63
2022-05-15 01:27:10.539: PIPE READ 0 71
2022-05-15 01:27:10.539: PIPE READ 8
2022-05-15 01:27:10.539: updated C: in 0.000338 seconds
2022-05-15 01:27:10.539: resume ntfs monitor 0
2022-05-15 01:27:10.539: PIPE WRITE 33 52
2022-05-15 01:27:10.539: PIPE READ 8
2022-05-15 01:27:10.539: PIPE READ 0 8
2022-05-15 01:27:10.539: PIPE READ 8
2022-05-15 01:27:10.539: processed 1 usn records in 0.000100 seconds
2022-05-15 01:27:10.540: DB_WAIT: _db_journal_notification_event_proc waiting for _db_monitor_ntfs_process_fd_update_events_thread_proc...
2022-05-15 01:27:10.540: DB_WAIT: _db_journal_notification_event_proc waited 0.000061 seconds
2022-05-15 01:27:11.368: new results 2461213
2022-05-15 01:27:11.376: ui->listview_was_focus_in_view 0
2022-05-15 01:27:11.551: PIPE READ 8
2022-05-15 01:27:11.551: PIPE READ 4
2022-05-15 01:27:11.551: PIPE READ 3 12
2022-05-15 01:27:11.551: update m 0 000000000abcde80
2022-05-15 01:27:11.551: PIPE READ 8
2022-05-15 01:27:11.553: update index C:
2022-05-15 01:27:11.553: PIPE WRITE 34 52
2022-05-15 01:27:11.553: PIPE READ 8
2022-05-15 01:27:11.553: PIPE READ 1784
2022-05-15 01:27:11.553: PIPE READ 0 1792
2022-05-15 01:27:11.553: USN DATA_EXTEND CREATE a69644d3-8ff8-4c87-b672-270d253fcf48.tmp
2022-05-15 01:27:11.553: PIPE READ 8
2022-05-15 01:27:11.553: USN CLOSE DATA_EXTEND CREATE a69644d3-8ff8-4c87-b672-270d253fcf48.tmp
2022-05-15 01:27:11.553: USN BASIC_INFO_CHANGE a69644d3-8ff8-4c87-b672-270d253fcf48.tmp
2022-05-15 01:27:11.553: USN BASIC_INFO_CHANGE SECURITY_CHANGE a69644d3-8ff8-4c87-b672-270d253fcf48.tmp
2022-05-15 01:27:11.553: USN CREATE TransportSecurity~RF1ae1be9f.TMP
2022-05-15 01:27:11.553: USN CLOSE CREATE TransportSecurity~RF1ae1be9f.TMP
2022-05-15 01:27:11.553: USN CLOSE DELETE TransportSecurity~RF1ae1be9f.TMP
2022-05-15 01:27:11.553: USN RENAME_OLD_NAME TransportSecurity
2022-05-15 01:27:11.553: USN RENAME_NEW_NAME TransportSecurity~RF1ae1be9f.TMP
2022-05-15 01:27:11.553: USN BASIC_INFO_CHANGE SECURITY_CHANGE RENAME_OLD_NAME a69644d3-8ff8-4c87-b672-270d253fcf48.tmp
2022-05-15 01:27:11.553: USN BASIC_INFO_CHANGE SECURITY_CHANGE RENAME_NEW_NAME TransportSecurity
2022-05-15 01:27:11.553: USN CLOSE RENAME_NEW_NAME TransportSecurity~RF1ae1be9f.TMP
2022-05-15 01:27:11.553: USN BASIC_INFO_CHANGE CLOSE SECURITY_CHANGE RENAME_NEW_NAME TransportSecurity
2022-05-15 01:27:11.553: USN CLOSE DELETE TransportSecurity~RF1ae1be9f.TMP
2022-05-15 01:27:11.553: PIPE WRITE 34 52
2022-05-15 01:27:11.553: PIPE READ 8
2022-05-15 01:27:11.553: PIPE READ 8
2022-05-15 01:27:11.553: PIPE READ 0 16
2022-05-15 01:27:11.554: PIPE READ 8
2022-05-15 01:27:11.554: read usn journal C: in 0.000723 seconds
2022-05-15 01:27:11.554: PIPE WRITE 35 20
2022-05-15 01:27:11.554: PIPE READ 8
2022-05-15 01:27:11.554: PIPE READ 83
2022-05-15 01:27:11.554: PIPE READ 0 91
2022-05-15 01:27:11.554: PIPE WRITE 35 20
2022-05-15 01:27:11.554: PIPE READ 8
2022-05-15 01:27:11.554: PIPE READ 8
2022-05-15 01:27:11.554: PIPE READ 63
2022-05-15 01:27:11.554: PIPE READ 0 71
2022-05-15 01:27:11.554: PIPE WRITE 35 20
2022-05-15 01:27:11.554: PIPE READ 8
2022-05-15 01:27:11.554: PIPE READ 8
2022-05-15 01:27:11.554: PIPE READ 4
2022-05-15 01:27:11.554: PIPE READ 2 12
2022-05-15 01:27:11.554: PIPE WRITE 35 20
2022-05-15 01:27:11.554: PIPE READ 8
2022-05-15 01:27:11.554: PIPE READ 8
2022-05-15 01:27:11.554: PIPE READ 4
2022-05-15 01:27:11.554: PIPE READ 2 12
2022-05-15 01:27:11.554: PIPE READ 8
2022-05-15 01:27:11.554: updated C: in 0.000726 seconds
2022-05-15 01:27:11.554: resume ntfs monitor 0
2022-05-15 01:27:11.554: PIPE WRITE 33 52
2022-05-15 01:27:11.554: PIPE READ 8
2022-05-15 01:27:11.554: PIPE READ 0 8
2022-05-15 01:27:11.554: PIPE READ 8
2022-05-15 01:27:11.555: DB_WAIT: _db_journal_notification_event_proc waiting for _db_monitor_ntfs_process_fd_update_events_thread_proc...
2022-05-15 01:27:11.555: processed 1 usn records in 0.000102 seconds
2022-05-15 01:27:11.555: DB_WAIT: _db_journal_notification_event_proc waited 0.000097 seconds
2022-05-15 01:27:11.555: processed 11 usn records in 0.000219 seconds
2022-05-15 01:27:11.555: DB_WAIT: _db_monitor_process_fd_update_event_finished_event_proc waiting for _db_monitor_ntfs_process_fd_update_events_thread_proc...
2022-05-15 01:27:11.555: DB_WAIT: _db_monitor_process_fd_update_event_finished_event_proc waited 0.000027 seconds
2022-05-15 01:27:12.379: new results 2461212
2022-05-15 01:27:12.388: ui->listview_was_focus_in_view 0
2022-05-15 01:27:13.378: new results 2461212
2022-05-15 01:27:13.385: ui->listview_was_focus_in_view 0
2022-05-15 01:27:14.380: new results 2461212
2022-05-15 01:27:14.385: ui->listview_was_focus_in_view 0
2022-05-15 01:27:15.368: new results 2461212
2022-05-15 01:27:15.373: ui->listview_was_focus_in_view 0
2022-05-15 01:27:16.369: new results 2461212
2022-05-15 01:27:16.374: ui->listview_was_focus_in_view 0
2022-05-15 01:27:17.372: new results 2461212
2022-05-15 01:27:17.378: ui->listview_was_focus_in_view 0
2022-05-15 01:27:18.369: new results 2461212
2022-05-15 01:27:18.374: ui->listview_was_focus_in_view 0
2022-05-15 01:27:19.370: new results 2461212
2022-05-15 01:27:19.375: ui->listview_was_focus_in_view 0
2022-05-15 01:27:19.816: PIPE READ 8
2022-05-15 01:27:19.816: PIPE READ 4
2022-05-15 01:27:19.816: PIPE READ 3 12
2022-05-15 01:27:19.816: update m 0 000000000abcde80
2022-05-15 01:27:19.816: PIPE READ 8
2022-05-15 01:27:19.823: update index C:
2022-05-15 01:27:19.823: PIPE WRITE 34 52
2022-05-15 01:27:19.823: PIPE READ 8
2022-05-15 01:27:19.823: PIPE READ 120
2022-05-15 01:27:19.823: PIPE READ 0 128
2022-05-15 01:27:19.823: USN DATA_EXTEND DATA_OVERWRITE CREATE ~FontCache-FontFace.dat
2022-05-15 01:27:19.823: PIPE WRITE 34 52
2022-05-15 01:27:19.823: PIPE READ 8
2022-05-15 01:27:19.823: PIPE READ 8
2022-05-15 01:27:19.823: PIPE READ 8
2022-05-15 01:27:19.823: PIPE READ 0 16
2022-05-15 01:27:19.823: read usn journal C: in 0.000432 seconds
2022-05-15 01:27:19.823: PIPE WRITE 35 20
2022-05-15 01:27:19.823: PIPE READ 8
2022-05-15 01:27:19.823: PIPE READ 8
2022-05-15 01:27:19.823: PIPE READ 95
2022-05-15 01:27:19.823: PIPE READ 0 103
2022-05-15 01:27:19.823: PIPE WRITE 35 20
2022-05-15 01:27:19.823: PIPE READ 8
2022-05-15 01:27:19.824: PIPE READ 8
2022-05-15 01:27:19.824: PIPE READ 67
2022-05-15 01:27:19.824: PIPE READ 0 75
2022-05-15 01:27:19.824: PIPE READ 8
2022-05-15 01:27:19.824: updated C: in 0.000428 seconds
2022-05-15 01:27:19.824: resume ntfs monitor 0
2022-05-15 01:27:19.824: PIPE WRITE 33 52
2022-05-15 01:27:19.824: PIPE READ 8
2022-05-15 01:27:19.824: PIPE READ 0 8
2022-05-15 01:27:19.824: PIPE READ 8
2022-05-15 01:27:19.835: processed 1 usn records in 0.000079 seconds
2022-05-15 01:27:19.835: DB_WAIT: _db_monitor_process_fd_update_event_finished_event_proc waiting for _db_monitor_ntfs_process_fd_update_events_thread_proc...
2022-05-15 01:27:19.835: DB_WAIT: _db_monitor_process_fd_update_event_finished_event_proc waited 0.000025 seconds
2022-05-15 01:27:20.375: new results 2461212
2022-05-15 01:27:20.381: ui->listview_was_focus_in_view 0
2022-05-15 01:27:20.820: PIPE READ 8
2022-05-15 01:27:20.820: PIPE READ 4
2022-05-15 01:27:20.820: PIPE READ 3 12
2022-05-15 01:27:20.820: update m 0 000000000abcde80
2022-05-15 01:27:20.820: PIPE READ 8
2022-05-15 01:27:20.820: update index C:
2022-05-15 01:27:20.820: PIPE WRITE 34 52
2022-05-15 01:27:20.821: PIPE READ 8
2022-05-15 01:27:20.821: PIPE READ 120
2022-05-15 01:27:20.821: PIPE READ 0 128
2022-05-15 01:27:20.821: USN CLOSE DATA_EXTEND DATA_OVERWRITE CREATE RENAME_NEW_NAME FontCache-Obsolete-609.dat
2022-05-15 01:27:20.821: PIPE READ 8
2022-05-15 01:27:20.821: PIPE WRITE 34 52
2022-05-15 01:27:20.821: PIPE READ 8
2022-05-15 01:27:20.821: PIPE READ 8
2022-05-15 01:27:20.821: PIPE READ 0 16
2022-05-15 01:27:20.821: PIPE READ 8
2022-05-15 01:27:20.821: read usn journal C: in 0.000636 seconds
2022-05-15 01:27:20.821: PIPE WRITE 35 20
2022-05-15 01:27:20.821: PIPE READ 8
2022-05-15 01:27:20.821: PIPE READ 101
2022-05-15 01:27:20.821: PIPE READ 0 109
2022-05-15 01:27:20.821: PIPE READ 8
2022-05-15 01:27:20.821: PIPE WRITE 35 20
2022-05-15 01:27:20.821: PIPE READ 8
2022-05-15 01:27:20.821: PIPE READ 67
2022-05-15 01:27:20.821: PIPE READ 0 75
2022-05-15 01:27:20.821: PIPE READ 8
2022-05-15 01:27:20.821: updated C: in 0.000438 seconds
2022-05-15 01:27:20.821: resume ntfs monitor 0
2022-05-15 01:27:20.822: PIPE WRITE 33 52
2022-05-15 01:27:20.822: PIPE READ 8
2022-05-15 01:27:20.822: PIPE READ 0 8
2022-05-15 01:27:20.822: PIPE READ 8
2022-05-15 01:27:20.822: processed 1 usn records in 0.000069 seconds
2022-05-15 01:27:20.823: DB_WAIT: _db_monitor_process_fd_update_event_finished_event_proc waiting for _db_monitor_ntfs_process_fd_update_events_thread_proc...
2022-05-15 01:27:20.823: DB_WAIT: _db_monitor_process_fd_update_event_finished_event_proc waited 0.000036 seconds
2022-05-15 01:27:21.377: new results 2461212
2022-05-15 01:27:21.385: ui->listview_was_focus_in_view 0
2022-05-15 01:27:22.371: new results 2461212
2022-05-15 01:27:22.377: ui->listview_was_focus_in_view 0
2022-05-15 01:27:23.368: new results 2461212
2022-05-15 01:27:23.374: ui->listview_was_focus_in_view 0
2022-05-15 01:27:24.377: new results 2461212
2022-05-15 01:27:24.383: ui->listview_was_focus_in_view 0
2022-05-15 01:27:25.106: failed to alloc 68154570
2022-05-15 01:27:25.371: new results 2461212
2022-05-15 01:27:25.377: ui->listview_was_focus_in_view 0
2022-05-15 01:27:25.813: failed to alloc 12139810
2022-05-15 01:27:25.818: failed to alloc 5275933
2022-05-15 01:27:25.923: failed to alloc 31033560
2022-05-15 01:27:25.927: failed to alloc 24899240
2022-05-15 01:27:26.276: failed to alloc 6168768
2022-05-15 01:27:26.276: failed to alloc 20523830
2022-05-15 01:27:26.304: failed to load stream C:\Users\....doc 8004170c
2022-05-15 01:27:26.346: failed to alloc 41263408
2022-05-15 01:27:26.358: failed to alloc 19912526
2022-05-15 01:27:26.369: new results 2461212
2022-05-15 01:27:26.378: failed to alloc 73634930
2022-05-15 01:27:26.378: ui->listview_was_focus_in_view 0
2022-05-15 01:27:26.483: failed to alloc 45096754
2022-05-15 01:27:26.747: failed to alloc 45984700
2022-05-15 01:27:26.813: failed to alloc 13459674
2022-05-15 01:27:26.813: failed to alloc 3726528
2022-05-15 01:27:26.814: failed to alloc 23224902
2022-05-15 01:27:26.815: failed to alloc 40585398
2022-05-15 01:27:26.822: failed to alloc 1870372
2022-05-15 01:27:26.893: failed to alloc 11445466
2022-05-15 01:27:26.899: failed to alloc 21444180
2022-05-15 01:27:26.960: failed to alloc 1141488
2022-05-15 01:27:26.962: failed to alloc 10181533
2022-05-15 01:27:26.963: failed to alloc 38752617
2022-05-15 01:27:26.964: failed to alloc 15424197
2022-05-15 01:27:26.964: failed to alloc 43865724
2022-05-15 01:27:26.981: failed to alloc 49073382
2022-05-15 01:27:27.018: failed to alloc 1936465
2022-05-15 01:27:27.034: failed to alloc 41791609
2022-05-15 01:27:27.047: failed to alloc 20034206
2022-05-15 01:27:27.075: failed to alloc 30911790
2022-05-15 01:27:27.133: failed to alloc 31543930
2022-05-15 01:27:27.142: failed to alloc 10886830
2022-05-15 01:27:27.163: failed to alloc 6402286
2022-05-15 01:27:27.164: failed to alloc 21115047
2022-05-15 01:27:27.165: failed to alloc 3104745
2022-05-15 01:27:27.167: failed to alloc 33898420
2022-05-15 01:27:27.167: failed to alloc 10989983
2022-05-15 01:27:27.168: failed to alloc 8438744
2022-05-15 01:27:27.173: failed to alloc 9990148
2022-05-15 01:27:27.173: failed to alloc 11616451
2022-05-15 01:27:27.203: PIPE READ 8
2022-05-15 01:27:27.203: PIPE READ 4
2022-05-15 01:27:27.203: PIPE READ 3 12
2022-05-15 01:27:27.203: update m 0 000000000abcde80
2022-05-15 01:27:27.203: PIPE READ 8
2022-05-15 01:27:27.203: update index C:
2022-05-15 01:27:27.214: PIPE WRITE 34 52
2022-05-15 01:27:27.214: PIPE READ 8
2022-05-15 01:27:27.214: PIPE READ 296
2022-05-15 01:27:27.214: PIPE READ 0 304
2022-05-15 01:27:27.214: USN CREATE 4beb7645-e38e-4c9e-8cfc-3e617eab5b37.tmp
2022-05-15 01:27:27.214: USN DATA_EXTEND CREATE 4beb7645-e38e-4c9e-8cfc-3e617eab5b37.tmp
2022-05-15 01:27:27.214: PIPE WRITE 34 52
2022-05-15 01:27:27.214: PIPE READ 8
2022-05-15 01:27:27.214: PIPE READ 8
2022-05-15 01:27:27.214: PIPE READ 0 16
2022-05-15 01:27:27.214: read usn journal C: in 0.011106 seconds
2022-05-15 01:27:27.214: PIPE WRITE 35 20
2022-05-15 01:27:27.214: PIPE READ 8
2022-05-15 01:27:27.214: PIPE READ 8
2022-05-15 01:27:27.214: PIPE READ 129
2022-05-15 01:27:27.214: PIPE READ 0 137
2022-05-15 01:27:27.214: PIPE WRITE 35 20
2022-05-15 01:27:27.214: PIPE READ 8
2022-05-15 01:27:27.214: PIPE READ 8
2022-05-15 01:27:27.214: PIPE READ 67
2022-05-15 01:27:27.214: PIPE READ 0 75
2022-05-15 01:27:27.215: PIPE READ 8
2022-05-15 01:27:27.215: updated C: in 0.000440 seconds
2022-05-15 01:27:27.215: resume ntfs monitor 0
2022-05-15 01:27:27.215: PIPE WRITE 33 52
2022-05-15 01:27:27.215: PIPE READ 8
2022-05-15 01:27:27.215: PIPE READ 0 8
2022-05-15 01:27:27.215: PIPE READ 8
2022-05-15 01:27:27.216: failed to alloc 11640100
2022-05-15 01:27:27.218: failed to alloc 12271482
2022-05-15 01:27:27.226: failed to alloc 11533599
2022-05-15 01:27:27.233: DB_WAIT: db_query_get_selection_count waiting for _db_monitor_ntfs_process_fd_update_events_thread_proc...
2022-05-15 01:27:27.264: failed to alloc 23733887
2022-05-15 01:27:27.304: failed to alloc 6106902
2022-05-15 01:27:27.313: failed to alloc 28302432
2022-05-15 01:27:27.331: failed to alloc 18511661
2022-05-15 01:27:27.344: failed to alloc 10807417
2022-05-15 01:27:27.347: failed to alloc 1884110
2022-05-15 01:27:27.350: failed to alloc 11455188
2022-05-15 01:27:27.355: failed to alloc 8870976
2022-05-15 01:27:27.357: failed to alloc 2966182
2022-05-15 01:27:27.359: failed to alloc 14142719
2022-05-15 01:27:27.369: failed to alloc 1064933
2022-05-15 01:27:27.369: failed to alloc 1045177
2022-05-15 01:27:27.388: .\src\mem.c(1077): mem_alloc(): Fatal error: out of memory 2663733
NotNull
Posts: 5458
Joined: Wed May 24, 2017 9:22 pm

Re: Everything crashes while indexing document contents (Fatal error: out of memory)

Post by NotNull »

Everything keeps the indexed content in RAM.
It is likely that you included too many files for the amount of available RAM.

@void wrote about this subject:
Everything will keep content in memory.
Content indexing is intended for indexing user documents only.
I do not recommend indexing over 1GB of text.
For the best performance, set an include only folder.
(link link )
void
Developer
Posts: 16680
Joined: Fri Oct 16, 2009 11:31 pm

Re: Everything crashes while indexing document contents (Fatal error: out of memory)

Post by void »

What settings are you using for content indexing under Tools -> Options -> Content?

There are some large files here.
Everything will attempt to pre-cache these large files.

This might be causing Everything to run out of memory.
This is made worse by using multiple threads for content indexing.
Normally Everything will use multiple threads for content indexing SSDs.

Could you please try reducing the number of content threads to 1:
  • In Everything, type in the following search and press ENTER:
    /content_max_threads=1
  • If successful, content_max_threads=1 is shown in the status bar for a few seconds.
content_max_threads
content_multithreaded_max_memory_percent



There could be a leak here.
A shell extension might be hanging onto the IStream.
Please try disabling extensions to see if the issue persists.
For example, remove *.pdf from the list of include only files.



I will look into disabling this pre-cache in the next alpha update.


Everything is not really designed for indexing over 1GB of raw text.
horst.epp
Posts: 1443
Joined: Fri Apr 04, 2014 3:24 pm

Re: Everything crashes while indexing document contents (Fatal error: out of memory)

Post by horst.epp »

I found it's the best to let Windows indexing the larger part of files and query it from Everything.
An allcontent: macro searches the indexed Everything content and the systemindex.
void
Developer
Posts: 16680
Joined: Fri Oct 16, 2009 11:31 pm

Re: Everything crashes while indexing document contents (Fatal error: out of memory)

Post by void »

Everything 1.5.0.1314a will no longer pre-cache files for content indexing.

This will reduce memory usage and increase performance when content index.
This will also improve preview rendering performance.



system-index:
Post Reply