I have spent quite a lot of time trying to find the best photo management solution for my use case, and i think i have finally got a solution in mind. Please follow me and help me understanding what could be improved.
The use case: I took, over the decades, thousand of pictures with manual, film based DSLR, digital DSLR and many other devices. Today i mostly only take pictures with my phone and occasionally (like 1-5 rolls per year) B/W film photos. I like to have all the pictures neatly organized per album. Albums are events, trips, occasion or just a collection of photos for any good reason together. I have always organized albums my folders and stored metadata either in the photo or in sidecar files. Over the decades i changed many management tools (the longest has been Digikam) but they all faded away for one reason or the other. I do not want to change organization since it proved solid over decades. I do not trust putting all eggs in a database or a proprietary tool format.
The needs: backup photos from family phones. Organize photos in albums (format as stated above), share & show pictures with family (maybe broader public too), archive for long term availability. Possibly small edits like rotation. Face recognition is a good plus, geographical mapping and reverse geotagging is a great plus. General object recognition could be useful but not a noticeable plus. Also i need multi-user support for family members both on backup and gallery-like browsing. My galleries need to be all shared (or better one big gallery, plus individual backups for users)
What i don’t need: complex editing / elaboration (would be done offline with darktable)
Non-negotiable needs: storing photos in album-based subfolders structure with all metadata inside photos or sidecar files. No other solution will ever stand the test of time.
I tried many tools and none fits the bill. Here are my experiences:
- Immich: by far the most polished, great for phone backup&sync, not good for album organization (photos cannot be sorted into folders, albums are logical only). Has the best face detection and reverse geocoding.
- Photoprism: given up because i don’t like open-source with money tags (devs have all the rights to ask for money, but i distrust a model where they might give up support unless they make money)
- Librephoto: feels abandoned and UI & Face detection is subpar with immich
- PiGallery2: blazing fast and great UI, but cannot be used for backups nor organization. But can cope well with my long lasting collections of photos.
- Piwigo: i used this decades ago. By today standards feels ugly bloated and slow as hell. No benefits anyway for my use case that compensate slugginesh. And my server is powerfull.
- Damselfly: great tool and super friendly dev, unfortunately i could not fit into my use case. It can work on folders, but it’s actions are too limited and beside downloads and exports and tagging… not much else. Not even backups from phone. I understand it’s use case is totally different from mine. Still a great piece of software.
My solution: more of the idea of how i want to proceed from here on…
Backup: keep the great Immich for phone backups. Limitations: requiring emails as user logins breaks my home server authentication scheme but i can live with it. The impossibility to organize photos in folders is a deal breaker but luckily, you can define “logical” albums and download them.
Organization: good old filesystem stuff, i don’t need any specific tools. Existing photos are already sorted in subfolders, new albums can be created from Immich, downloaded, and stored on new subfolders on the server. Non-phone albums (DSLR, film cameras…) can just be added as well directly on filesystem
Viewing: PiGallery2 pointed at the subfolders, blazing fast viewing online for all family members.
Global workflow: take photos from phones, upload automatically to immich, then manually go sort them in albums, download albums and create appropriate subfolders on the server (if needed to save space, delete downloaded photos from immich). Upload/unzip and enjoy from PiGallery2. – OR – take photos with other cameras, scan/process on PC (darktable), create appropriate subfolders on the server, upload and enjoy from PiGallery2.
All in all what pisses me off of all this is:
- Immich requiring a fucking email address to login (not a privacy concern here, but my users will need to remember a different login for this specific part)
- Immich not supporting subpaths, i will need two subdomains to achieve this workflow, while just one would have been less complex for the users (something like photos.mydomain.org/gallery and photos.mydomain.org/backup, instead of photobackup.mydomain.org and photogallery.mydomain.org, you get the idea). I know all the blah blah on subdomains being better and such, i don’t care, this is an usability issue for dumb users and, in general, it’s the way i prefer it to be.
Of course, the best course would be to have Immich support folders (not external libraries, but actually folder based albums which is totally different approach) and it being able to move photos to folders, but hey, it wouldn’t be fun in that case :)
Amy thoughts?
Immich does support folders?
https://immich.app/docs/administration/storage-template/
With this you can store your photos in whatever structure you want.
I see this is something different from external libraries (to which applies my other comment). It doesn’t seems to be working for existing external libraries but only for new uploaded files? I will need to check this out more in deep. thanks.
There’s a couple of caveats with it, but I think neither are worse than your proposed flow.
- After putting things in an album you’ll need to manually run the migration job to have immich reorganise into album folders.
- Images in multiple albums will only be migrated to the path of the newest album.
It’s actually what i was looking for… I need to understand if it’s solid enough for long term usage and how to mix that with my existing photo collection, but it really seems that this feature will cut out the need to manually download & move the photos from Immich to PiGallery2…
No it doesnt. It only support ready photos from folders, then the original structure is lost inside Immich, you cannot even see the folders only the big “timeline”. All albums (=folders) disappear in immich, It’s useless for my use case.
Immich having accounts+SSO is the single best feature IMO. Thanks for your thoughts on the topic.
I have not setup authelia or similar, i am using proxy auth linked to PAM to simulate SSO. I might end up using authelia or similar in the future to solve this specific issue indeed.
I don’t have as complex a collection but gthumb on a laptop was ok. Or for a while I used a script that made an html page of clickable thumbnails that I viewed in a browser. That was very fast. For uploading from my phone I use a self hosted nextcloud and I back everything up with Borg. I’ll look over your list again since the programs you mention sound way too complicated. It should be possible to do what you want with a few simple scripts on a server, plus a browser or gallery app on your phone.
I do think being able to have photos in multiple collections is useful. That can be implemented with something like tags.
The scripts approach might be a good solution as well, but i tend to bake my solutions a bit too much already…
I struggled with this for a long time, and then I just decided to use synology photos.
It has albums, tagging, geolocation, sharing. It has phone picture backup, it is inherently a backup as it’s on my NAS and I back that data up again.
I want to keep the thing that I really care about the most friction free and also not too dependent on myself so that I can still experiment.
I didn’t try PiGallery2 though, maybe I will have a look!
I don’t have a sinology, and i dont want to use proprietary stuff… so i never looked into it
I don’t have your requirements, but nextcloud with Memories works well enough for me. Nextcloud does the file things, including auto upload from phones. Memories then displays those photos.
I moved away from nextcloud after many years, it was time to explore new stuff I guess.
I never used memories before anyway
I’m honestly so happy to be using Synology Photos. It reads my folder structure; leaves EXIF data alone; unless I want to change it (i.e. time/date); has great sort and search features; I can easily share photos/albums with people, even for them to add photos to my albums; and the mobile apps “just works” for viewing and backing up my photos and videos from multiple devices.
Yes, it’s “proprietary”, but it doesn’t hold your images hostage as something like a proprietary database would. I’m free to explore my photos using any third-party I like, simply by pointing to where they are stored on the NAS.
And while it has some OK subject recognition, I pair it with Exire Foto for mind-blowing, local AI-based search if I need to find something very specific in my collection of 125,000+ images.
What’s the best sidecar format?
I’m a prosumer/hobbiest photographer for 20+ years and started from film as well. I have spent countless days/months of my life migrating from systems to systems. While my subsystem is folder based and all tags are on the photo itself, not every software is alike and migrations becomes a chore.
The major issue with software systems like digikey(which I also had) is that they all eventually stop support. After switching to Synology, I have everything you are asking for and more. I went from a 2 bay system, to a 4 bay system and currently on an 8 bay system. Each time it was super seamless. Ran out of space? Pop a new drive in. A drive is starting to fail? It takes your spare drive and automatically brings it into rotation and emails you telling you to replace the spare drive. It does an automatic monthly data scrubbing to ensure data integrity. Seriously so much more. I recently added a docker container for Joplin(a notes, journaling app).
Quite literally zero fiddling, and zero headaches.
I have 8 family members using my system and it’s super easy to implement. Give them the credentials and ask them to download from the play store or Apple store.
Yes it’s proprietary. And moving from Synology to another system will probably be a chore too. But honestly, it’s so simple that I’m willing to some money on it on that less headache.
I went through this as well. This resource should help those starting out: https://github.com/meichthys/foss_photo_libraries
Have you looked at https://ente.io? Recently published on github and can self host.
Acronyms, initialisms, abbreviations, contractions, and other phrases which expand to something larger, that I’ve seen in this thread:
Fewer Letters More Letters HTTP Hypertext Transfer Protocol, the Web HTTPS HTTP over SSL NAS Network-Attached Storage SSL Secure Sockets Layer, for transparent encryption SSO Single Sign-On
[Thread #618 for this sub, first seen 20th Mar 2024, 18:35] [FAQ] [Full list] [Contact] [Source code]