macOS external drive - Omnis DataBridge / Postgres issues

[Andy McVeigh]

Not sure if this is relevant but using external drives for Time Machine backups and since OS 15 upgrade the 'Volume has been disconnected' message regular comes up and then it just reconnects later on

I have checked all cables and replaced and tried different drives and the pattern continues but the TM backups get done 

Maybe it is this intermittent loss of connection to external drives

Andrew McVeigh
Surfway Real Solutions
Phone 02 44412679 Mobile 0418428016
www.surfway.com.au
www.berrarabeach.com.au

 <http://www.surfway.com.au/>
> On 12 Feb 2025, at 2:48 am, Doug Easterbrook via omnisdev-en <omnisdev-en at lists.omnis-dev.com> wrote:
> 
> hi Nick.
> 
> You should talk to apple — I truly suspect it is a gate keeper problem.    Apple (and their penchant for uber security) has done a disasterous job allowing software running on a machine to access just about anything.
> 
> Yesterday Ben Weinberg reported a problem writing print files or pdf’s to external drives.     In a short test of my own. I tried to CD into an external mounted volume and got forced to give permission to terminal (as in apple’s terminal app that is part of the root/base BSD unix shell) to allow it to access any external volume.    
> 
> Others on the list have complained as well for other reasons, always with Mac OS, and worse on apple silicon machines.
> 
> 
> 
> you might try giving postgres 'full disk access' in system processes.
> 
> 
> 
> on the other hand, I’d suggest NOT using external drives with databases (or other 24x7 processes) on MAC os.     You might want to use linux or free BSD instead.
> 
> 
> I have had zero issues with postgres on OSX when the data is on the local machine, and I suspect thats because postgres talks to everything within its own directory, which apple seems fine with.
> 
> 
> 
> 
> 
> the other thought I might have is that perhaps postgres crapped out on you.   The postmaster.pid file is a small file that indicates postgres is running, or if it shut down cleanly.   its is normally in the data directory (on the local machine).    If you’ve put the entire data directory on an external drive ….   might be that postgres restarted itself, or did something with the file.
> 
> https://www.crunchydata.com/blog/postgres-postmaster-file-explained
> 
> 
> 
> 
> bottom line, postgres is so light (i.e. doesn’t take up much space on a drive) that there is no reason not to run it on a local drive, vs a network drive.
> 
> if you want data on a network drive, why not run postgres on that machine ???
> 
> 
> 
> 
> Doug Easterbrook
> doug at artsman.com
> Phone (403) 650-1978
> 
>> On Feb 11, 2025, at 1:32 AM, Nick Renders via omnisdev-en <omnisdev-en at lists.omnis-dev.com> wrote:
>> 
>> Hello,
>> 
>> We are having intermittent issues with external drives on macOS Sonoma (14) and Sequoia (15).
>> Sometimes, the privileges of certain ( or maybe all? ) files seem to momentarily change.
>> 
>> The issue is most noticeable when we have a Postgres data directory located on an external volume. The Postgres service is running fine, then all of sudden, we are no longer able to connect to the database. In the Postgres log, the following is logged every minute:
>> 
>> 	2025-02-10 22:12:06.198 CET [10267] LOG:  could not open file "postmaster.pid": Operation not permitted; continuing anyway
>> 	2025-02-10 22:13:06.223 CET [10267] LOG:  could not open file "postmaster.pid": Operation not permitted; continuing anyway
>> 	2025-02-10 22:14:06.225 CET [10267] LOG:  could not open file "postmaster.pid": Operation not permitted; continuing anyway
>> 	2025-02-10 22:15:06.227 CET [10267] LOG:  could not open file "postmaster.pid": Operation not permitted; continuing anyway
>> 	2025-02-10 22:16:06.230 CET [10267] LOG:  could not open file "postmaster.pid": Operation not permitted; continuing anyway
>> 	...
>> 
>> This continues until we restart the Postgres service (pg_ctl restart).
>> 
>> The same issue occurs with Omnis Datafiles: when we run an Omnis DataBridge with the datafiles located on an external volume, at some point, the files are no longer accessible. The ODB service continues running, but trying to open a Datafile will result in the following error in messages.txt of the ODB:
>> 
>> 	Loading user config file...done
>> 	Client IP = 127.0.0.1: Omnis Bridge Error: Unable to open specified segment
>> 	System Error 1 : Operation not permitted
>> 	Loading user config file...done
>> 	Client IP = 127.0.0.1: Omnis Bridge Error: Unable to open specified segment
>> 	System Error 1 : Operation not permitted
>> 	Omnis Bridge Error: Error while waiting for messages
>> 	System Error 54 : Connection reset by peer
>> 
>> Restarting the ODB service fixes the issue again.
>> 
>> 
>> We've noticed this issue with 3 different volumes, two being a Promise Pegasus RAID, the third being a simple SSD connected with USB-C. The servers have been both Intel and Silicon Macs (i7, M1, M2) running Sonoma or Sequoia.
>> The external volumes have "Ignore ownership" turned on in the Info window in the Finder. We have tried adjusting the user privileges/ownership of specific folders, but no change.
>> 
>> The issue is very intermittent. The server can be running great for a couple of hours, then it happens out of the blue. As you can see in the Postgres log above, it first occurred at 22:12, when nothing else was happening on the machine.
>> 
>> 
>> Does this sound familiar to anyone?
>> Any ideas or suggestions?
>> 
>> 
>> Kind regards,
>> 
>> Nick Renders
>> _____________________________________________________________
>> Manage your list subscriptions at https://lists.omnis-dev.com
>> Start a new message -> mailto:omnisdev-en at lists.omnis-dev.com
> 
> _____________________________________________________________
> Manage your list subscriptions at https://lists.omnis-dev.com
> Start a new message -> mailto:omnisdev-en at lists.omnis-dev.com