System.OutOfMemoryException

[dokuzsekiz]

268000 document read, when I get the following error.

System.OutOfMemoryException

[UziTech]

This program reads all documents into memory in order to construct the tables. It can quickly eat up all the available RAM. I will see what I can do to offload some of the information.

[MySChik]

268000 document read, when I get the following error.

System.OutOfMemoryException

Hi,

Anyone has any solution? sorry, I'm new in this.

[UziTech]

One solution could be to use temporary files instead of ram to load the data.

Any pull requests would be appreciated.

[jaishmathews]

It's not system RAM. I checked and confirmed that system RAM is available, but this 32 bit application running in 64 bit machine is producing memory error for me in a loop of total 587848 documents, once reached 218000+ item. So this memory meant by internal to application, not system. We can't convert this to 64 bit based as of COM dependency I think.

System.OutOfMemoryException: Exception of type 'System.OutOfMemoryException' was thrown.
at System.Threading.ExecutionContext.Capture(StackCrawlMark& stackMark, CaptureOptions options)
at System.Threading.ExecutionContext.Capture()
at System.Windows.Forms.Control.MarshaledInvoke(Control caller, Delegate method, Object[] args, Boolean synchronous)
at System.Windows.Forms.Control.BeginInvoke(Delegate method, Object[] args)
at System.Windows.Forms.WindowsFormsSynchronizationContext.Post(SendOrPostCallback d, Object state)
at System.ComponentModel.AsyncOperation.Post(SendOrPostCallback d, Object arg)
at System.ComponentModel.BackgroundWorker.ReportProgress(Int32 percentProgress, Object userState)
at ProgressDialog.ReportProgress(Int32 percentProgress, Object userState) in C:\EPD\NSF2SQL-master\NSF2SQL\ProgressDialog.cs:line 129
at NSF2SQL.Form1.<>c__DisplayClass15_0.<bExportDocuments_Click>b__0(Object dialog, DoWorkEventArgs e) in C:\EPD\NSF2SQL-master\NSF2SQL\Form1.cs:line 451

[jaishmathews]

One solution could be to use temporary files instead of ram to load the data.

Any pull requests would be appreciated.

You meant by using files in place of existing object Dictionary<string, Table>?

[UziTech]

Yes. Removing the need to keep everything in memory by saving to files or something could help when there are lots of documents.

[SalihArik]

Could anyone solve the System.OutOfMemoryException error?