Database weird results, memory leaks?

Databases
1

Hello,

So , I have a MSSQL Database server, around 4 GB of data there, I Extract around 400 Mb of data and store that in a DB.

Here is the first issue I get.

Using Windows 10 and ODBC.

When I do the Query, I get the data but on writing to the SQLite DB always on each table first record does not want to store String Columns , no idea why, so I have 23 tables where I need to take them one by one to manually copy / paste the data from the first row, no idea why.

Moving to MacOS , Mac mini M1 I start the processing.

doing a simple query and moving the data from multiple tables to one table I end up after around 190.000 records with a Memory usage of 44,37 GB for my app. Following the standards doing the query, getting the data from each row and saving them on db with the DatabaseRow.

Is that normal ? I mean the speed is super fast for all this processing it took like 3 min but still that memory usage is huge. all this is done in a thread.

Now the 3rd step is another processing where I call a shell to extract the rtf data from DB and convert it to txt using textutil, it goes well so far but the shell is painfully slow and memory keeps increasing , Reached on 10.100 Records from 95000 and memory is already on 45,37 GB apparently each 10k records it grows with 1 GB

Is this a memory leak or something in the DB side that is wrong ?

Latest macOS Monterey and XOJO 2021R2.1

Screenshot 2021-11-14 at 21.07.57
Screenshot 2021-11-14 at 21.07.57770×62 3.66 KB

Thanks.

2

Monterey is known to have a bug that uses very large amount of memory when not needed.
don’t know if this has been corrected or not…
I don’t install any new apple os until march of next year if possible …

3

hmm so in the end this is a XOJO, XOJO App issue or a MacOS issue ? as this huge growing is super weird and not normal I guess, now makes me worried on crashes that I might have as the Memory jumps like crazy from 300 MB to 3 GB , then 10, and so on until It reaches to that amount.

I do close RowSet after every process and try to clean as much as possible the tasks but still.

4

I guess I’ll try as well on my old Intel Mac with Catalina and see if I have same issue or not, that would be nice to know.

1 Like
5

Well, exactly the same issue, on Intel Mac so I assume that is a XOJO Memory Leak here. Now the funny part is to find out where

6

I have a whole series of articles on finding memory leaks with Instruments: Blog: News and Tutorials about Mail Archiver

1 Like