Importing 20 Million Records

Sten-Erik Björling s-e.bjorling at
Fri Jun 25 21:19:03 UTC 2021

Maybe a Python worker object?

Nudge, nudge Omnis...



> 25 juni 2021 kl. 23:10 skrev Ben Butler <760.f563 at>:
> Hi,
> I would write a loader routine that was responsible for reading in the data and putting it into the database / whatever you want to do with it.  For that I would call from Omnis to a python script. Python is able to read files line at a time without having to load it all into ram.
> This mean you can load in any amount of source records / size of import file.
> My 2c, python plus Omnis is a very powerful combination and easy to integrate and exchange messages in both directions.
> Ben

Sten-Erik Björling
Enviro Data
Kyrkogatan 5A 2 tr
SE-972 32  Luleå

E-Mail: s-e.bjorling at
Mobile: +46-70-655 11 72
Wire: @stenerikbjorling
Skype: stenerikbjorling
iChat: stene at
FaceTime: stene at stenerikbjorling
Hotmail / Messenger: stenerikbjorling at
GMail: stenerikbjorling at

This email and any files transmitted with it are confidential, may be legally privileged and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the intended recipient, please note that any use, distribution, or reproduction of the contents of this email is strictly prohibited and may be unlawful. If you are not the intended recipient, please notify the sender by return email and destroy all copies of the original message including any attachments thereto. Thank you.

Please note that we take reasonable precautions to prevent the transmission of viruses; however, we cannot guarantee that this email or its attachments are free from viruses. We only send and receive emails on the basis that we are not be liable for any loss or damage resulting from the opening of this message and/or attachments.

More information about the omnisdev-en mailing list