Jeffrey’s “Folder Publisher” Lightroom Plugin

This Lightroom “Publish” plugin allows you to export copies of your Lightroom photos to disk in a folder hierarchy that mimics the folder hierarchy in your Lightroom catalog. I've found it very useful in mirroring my Lightroom catalog as small JPGs on my wife's computer.

This plugin works in Lightroom Classic, and older versions as far back as Lightroom 3 (though some features depend on the version of Lightroom).

The same download works for both Windows and Mac. See the box to the upper right for the download link (in orange) and installation instructions.

This is a sister plugin to my Collection Publisher plugin (which is similar to this plugin, except that plugin mirrors a collection hierarchy instead of a folder hierarchy).

Unlike a normal export, this Publish service allows you to create an ongoing relationship between the photo in Lightroom and the copy on disk. The tree on disk is refreshed for any changes (new images, removed images, and image changes) each time you “Publish”.

The plugin is normally used in the following pattern:

  1. Initial setup of the publish service.
  2. Populate the default collection with image you want to mirror, or create a smart collection that identifies the images you want to mirrors.
  3. “Publish” them, causing copies of the images to be reflected into a hierarchy on disk matching the folder hierarchy in Lightroom.
  4. Going forward, any time changes are made (images updated, added, or removed), “Publish” causes those changes to be reflected on disk.

Publish-Service Setup

When setting up a new publish service, you first assign a name, though you can leave it blank if you'll only have one...

You indicate where published copies are to be placed by specifying the root of the publish tree. When first setting up a new publisher, you'll likely want to pick an empty folder as the root.

The next sections are all part of the standard Lightroom export. In them you decide the size and quality of the published copies...

The next two sections shown in the example aren't included unless you specifically add them:

They're from my crop for iPad and Metadata Wrangler plugins; I use them in my exports to allow me extra control of what metadata is included in each exported copy, and in the case of my iPad portfolio, special iPad-specific crops so that some images better fill the screen.

The next section controls what changes in Lightroom should cause published images to be slated for republish.

Then we have a plugin-specific seciton on file renaming that gives much more flexability than Lightroom's standard “File Naming” section, should you need it:

This allows you to have the files for the exported copies named derived from image matadata using template tokens that are processed on the fly for each image.

The next section provides a way to do an FTP sync of the published copies, should you need it. Photo-viewing iPad apps tend to allow updates via FTP sync, so this section is convenient for that.

It's here as a convenient tool rather than an actual part of the configuration; the FTP sync is never automatic... it happens only when you launch it manually from the Publishing Manager.

The plugin also provides a way to import and export settings, making it easier to set up comparable publish services on multiple catalogs (such as when part of your library is on your desktop, and part on your laptop, as is my case).

When first setting up a service, you'll have the ability to import settings...

... but once it's been set up the first time, after that the section allows for export:

Collection Setup

Once you've got the publish service created, you can drag images into the default collection, or you can create your own collections, including “smart collections” that identify images to include via rules (e.g. “all five-star images”).

The default publish location for any image in any collection is that its folder structure in Lightroom is replicated and placed starting at the root folder chosen when you set up the publish service. However, you can modify aspects of how image locations are mapped when you create/edit a collection:

Special "Smart Preview Export" Mode

The plugin, in Lightroom 9.2 or later, includes a special mode to export Lightroom's "smart preview" files, DNG-format reduced-quality (reduced-size) versions of the master original image files. These files include no Lightroom updates (image or metadata edits). This mode might be useful for a kind of lightweight backup.

This mode can be turned on only when a publish service is being created. For a publish service that has this mode active, standard publish options related to the export image files — format, size, quality, metadata, etc. — are still presented, but play no part in the actual publish operation because the plugin . (I would like to make them disappear just for this mode, but Lightroom's plugin infrastructure doesn't allow for it.)

This experimental mode has been hacked into the plugin in a pretty sloppy way, just to see whether it's useful. At this point, the publish service, like all publish services, moves edited files back into the "files to republish", even though such edits within Lightroom don't affect the published output of this plugin as they do all other plugins.

Availability

This plugin is distributed as “donationware”. I have chosen to make it available for free — everyone can use it forever, without cost of any kind — but unless registered, its functionality is somewhat reduced after six weeks.

Registration is done via PayPal, and if you choose to register, it costs the minimum 1-cent PayPal fee; any amount you'd like to add beyond PayPal's sliding fees as a gift to me is completely optional, and completely appreciated.

Note: a Lightroom major upgrade, such as from Lr6 to Lr7 (or the equivalent under the hood for the Lightroom Classic subscription) de-registers the plugin in the upgraded version, so if you want to maintain registration, a new ($0.01 if you like) registration code is needed in the upgraded version. It makes for a hassle every couple of years, I know. Sorry. See this note for details.

For details on plugin registration and on how I came into this hobby of Lightroom plugin development, see my Plugin Registration page.

Version History
( Update Log via RSS )

20210721.117

Don't crash when the plugin is told not to handle videos, but a video is included in the export anyway.

Fixed that the Province template token did not respect the plugin-specific geo-privacy settings.

Upgraded to the embedded copy of ExifTool to version 12.25.

Fixed an issue with the {Newline} token, and added {Comma}, {Hyphen}, and {Space} for good measure.

Fixed a problem with filters on the {Keyword} token.

20210503.116

Added an experimental Smart-Preview-Export Mode.

Reverted the name-conflict workaround added in 20190815.103 for versions of Lightroom that have had that bug fixed.

20210415.115

Added 'separated by' to the People token.

20210302.114

Reworked the Keywords token to better accept filters.

20210211.113

Fixed the plugin crashing in the face of a failed video render.

20210116.112

Try to work around filename issues on Windows when trying update the filesystem time.

working around 'constant table overflow' error

Added the ImageViewDirection and ImageViewBearing tokens.

20201103.111

Added the PF filter to turn typographic fractions into plain-ASCII fractions.

20201017.110

Updates for Lr10

Be more aggressive in trying to figure out the capture time of photos when trying to set the export file time to the capture time.

Added the SpeedKnots token.

Worked around an "unknown key captureTime" error.

Added the {PlusCode} and {GeoHash} tokens.

Handle FTP errors better.

20200604.109

Added some extra debug logging.

20200516.108

Oops, one wasn't offered the ability to change the root of the publish tree if the original folder no longer existed.

20200421.107

Fixed a reporting error with the new find-misshing-published-photos feature.

20200414.106

Added the ability to find missing published photos and have them marked for republish.

Some of the filename-related tokens could be incorrect in rare situations.

20200328.105

Fixed a bug WRT database access while moving the destination root.

Work around a Windows bug related to canceling out of the registration dialog.

Added some extra debug logging to note whether the plugin is enabled.

20191029.104

Upgraded to the embedded copy of ExifTool to version 11.70.

Added special {AbsSequenceFirst=####"} and {AbsSequenceAppend=####} tokens.

Added the LensInfo template token.

Updated the Exposure token to allow customization.

More token work: added {Urls}, and updated {ISO} and {Copyright} to allow customization.

Added the {RelativeFolder} token.

20190815.103

Work around a bug in Lightroom related to filename conflicts (where two exported files have names that differ only in lettercase).

Fixed the SST1 and SST2 tokens.

20190801.102

Fixed a bug in the name-change scan.

20190731.101

Updated the PublishCollectionName token (and CollectionNames and CollectionFullNames) to remove the MIRROR: prefix from the name that mirrored collections within my Collection Publisher plugin automatically get.

20190708.100

Newline token.

Fixed a problem related to template tokens and photos without capture times.

Upgraded to the embedded copy of ExifTool to version 11.50.

Added functions uc(), ucFirst(), lc(), and lcFirst() to the LUA token.

20190514.99

Added the ability to notice when files have their filename or folder changed.

Fixed an issue with {SequenceFirst}.

Work around a bug that sometimes causes plugins to be disabled when starting Lightroom via clicking on a catalog file.

Fix an "Unknown key: captureTime" crash.

Added the GPSCoords token.

20190308.98

Updated the keyword-related tokens to accept standard filters.

20190307.97

Upgraded to the embedded copy of ExifTool to version 11.30.

20190228.96

Added the {Exiftool=...} template token.

20190114.95

Added some extra debug loging.

If the plugin's attempt to create a folder fails, try again a few times before actually reporting the failure.

Added the PEOPLE variable to the LUA token.

Fixed a problem with the SpeedKPH token.

Added the TempC and TempF tokens.

20181015.94

Updates for Lr8 (Lightroom Classic CC Version 8).

Added the special PP() function to the {LUA} token.

Added hierarchical options to the Keywords token.

Try to work around a Lightroom bug related to photo timezones and how Lightroom handles accessing plugin data.

20181004.93

Added the 'nicknames' modifier to the {People} token.

Added the SST1, SST2, and SS3 tokens to the template tokens that the plugin understands.

20180906.92

Try to avoid having unexpectedly-long error messages create too-big a dialog.

20180803.91

Limit the amount of temporary disk used by Lightroom before handing files off to the plugin.

20180608.90

Added some extra debug logging.

Clicking on the version number in the Plugin Manager now copies version info to the clipboard

Updated the PublishCollectionName token to allow numeric arguments along the lines of the CollectionName token.

Added the folowing template tokens: {home}, {desktop}, {temp}, {pictures}, {documents}, IptcDateTaken

Added the 'PCH' variable to the {LUA} tag.

20180420.89

Fixed a bug when 'Token Examples' invoked in certain situations.

Added a bunch of token filters: F2D F2S F2X B2D B2S B2X S2X A2D A2S A2X

20171229.88

Updates to the data templates that my plugins understand: updated the Keywords token, added CollectionNames and CollectionFullNames tokens, and added a bunch of stuff (KWf, CN, CFN, CNf, CFNf) to the {LUA} token.

20171019.87

Oops, more Lr7 stuff.

20171019.86

Updates for Lr7.

Better handle some character-encoding issues related to template tokens.

Allow the "If Exists" feature of Templat Tokens to work with the PluginProperty token.

Update registration support to handle a stupid bug at PayPal that PayPal refuses to fix )-:

20170705.85

Fixed a bug introuded the other day in template tokens, related to Windows filenames.

Added extra debug-logging to track down a timing issue.

20170621.84

Added the Newline template token.

Enhanced the FolderName token

Added the "only if it has a value" feature to template tokens.

20170309.83

Added the following tokens to the template tokens that my plugins understand: Artworks, ArtworkTitle, ArtworkCopyright, ArtworkSource, ArtworkCreator, ArtworkDateCreated, ArtworkInventoryNum

20170224.82

Couldn't set the exported-copy file date older than about 50 years ago; fixed.

20170216.81

The rules about what characters are disallowed in a folder name were too aggressive, so relax them.

Fixed a bug with the keyword tables in the LUA token.

Added Weekday, Wday, weekday, wday, and ISO8601Date to the list of template tokens that my plugins understand.

Switch the log-sending mechanism to https.

20160905.80

Better support for network shares on Windows.

20160828.79

Added the following tokens to the templates that my plugins understand: {FilenameNumber}, FileModYYYY, FileModYY, FileModMM, FileModDD, FileModHH, FileModMIN, FileModSS, FileYYYY, FileYY, FileMM, FileDD, FileHH, FileMIN, FileSS.

20160430.78

Fix to get around a Mac display issue with Lr6 on OSX.

Added Russian-langauge support for the People-Support {People} tag.

Added more debug logging to track down some issues.

20160217.77

Added ChildOf and DescendantOf filters to the {Keywords} and {KeywordsAll} template tokens that my plugins understand.

Fixed how custom {People} formatting works with people keywords that have no birthday associated with them.

Try to avoid yet another place where Lightroom gets hung because it can't handle certain kinds of dialogs at the same time.

20151115.76

If there's an error exporting one particular image, try to continue with others and merely have Lightroom report a summary of errors at the end.

Added support for sequence numbers on publish. See the "sequence numbers" link in the "Enhanced File Renaming" section of the dialog.

Added {SpeedKPH} and {SpeedMPH} to the list of template tokens supported by my plugins.

The {People} token wasn't working properly for some keywords without a registered birthday.

20150831.74

Allowed the Enhanced File Renaming to actually create sub-folders under where an image would normally be placed.

20150517.73

Fixed the "SpecPeople:259: attemt to index al nil value" error.

20150222.72

If the root folder of the publish tree had a very long name, the view/change buttons would be pushed off the edge of the screen.

20150219.71

In the "Enhanced File Renaming" section, add the ability to override the extension on the exported filename.

20150206.70

In the POODLE-vunerability dialog, display a raw URL of a page on my site that discusses the issue, so that folks can be independently sure that the dialog is indeed from me and not malware.

20150131.69

Updated the camera-name code to try to guess the actual camera model of Hasselblad H5D files, since in their infinite wisdom Hasselblad decided to encode three distinct models with the same internal code, making it impossible to know for sure what camera produced a given image file.

20150103.68

Fix to the date_diff() function supported by the LUA template token.

20141215.67 Added a bit more debug-logging for when a file copy can't be done.
20141019.66 Windows Only: Add a one-time check for the POODLE security vulnerability, and alert the user if it exists.
20141005.65 Clicking on the blank area next to the upper-right [Publish] button caused an error dialog to display.
20140923.64 Added the LrMD5, LrLocalization, LrSystemInfo, and LrMath packages to the {LUA} template token.
20140922.63 Workaround for a Lightroom bug that causes the plugin to croak on certain folder names.
20140920.62 Some extra debug logging to track down a problem.
20140902.61 New build system
20140802.60

Made the {GPSAltitude}, {Altitude}, and {GPSCoordinates} tokens subject to the geo-privacy settings like the other geo-related tokens.

20140731.59 Registration fix for Lr5.6
20140720.58 More Creative-Cloud support.
20140715.57

Fixed an issue with Creative-Cloud revalidation.

20140712.56

Lr5.5 and later Creative-Cloud installs can now revalidate themselves if needed.

20140710.55 Sigh, had a bug in the Creative-Cloud support.
20140708.54

Now supports Lr5.5+ Creative-Cloud Installs.

20140704.53 Sigh, introduced an error for some folks with the rebuild the other day.
20140630.52 Build-system update
20140613.51

Added date_diff() and raw_time_diff() functions to the special {LUA} token understood by the plugin.

20140612.50 Under some error conditions plugin would crash instead of presenting the proper error message.
20140509.49

Added new tokens to the template language the plugin understands: LrVersion, LrVersionMajor, LrVersionMinor, LrVersionRevision, LrVersionBuild, Location, CatalogName, CatalogPath, OperatingSystem, OS

Added new token filters: NS and LO

20140423.48 Fix a location-related template-token bug introduced in a recent build.
20140422.47

Fixed a bug in the "smoother revalidation" stuff recently added.

20140417.46

Enhancements to the FTP stuff: take care not to work with "." and ".." that some servers return.

The {Empty} template token wasn't working properly.

Make the revalidation process smoother, especially for folks using Lr5.4 and later.

20140410.45

Added an option to limit the overall depth of the publish tree.

20140321.44

Internally track whether exports are via the master image or via a smart preview. In the future this may allow for a "republish those for which a master is now available" feature.

Worked around a mysterious "attempt to get length of a nil value" bug.

20131213.43 Added {PublishCollectionName}, {PublishCollectionDepth}, and {PublishServiceTitle} tokens to the preset templates. See template-token web page for important restrictions.
20131102.42 Update for OS X Mavricks
20131010.41 Yikes, it seems that version 20130905.36 broke the "Metadata that Triggers Republish" section, clearing all items you might have had set (well, all but Caption). Sorry about that. Please visit the "Metadata that Triggers Republish" section to reconfigure to your liking.
20130926.40 Oops, fix a bug introduced in the previous update
20130925.39

The 'Template Examples' dialog had been broken. Deprecated 'Folder' and 'Path' tokens in preference to 'FolderName' and 'FolderPath' tokens.

20130923.38

Added a bunch of tokens to the preset templates supported: ExportFormat, ExportColorSpace, ExportBitDepth, ExportQuality, ExportSharpeningLevel, ExportSharpeningMedia, IpernityUrl, GoogleDriveUrl, and TumblrUrl.

Additional debug logging.

20130909.37

Work around a Lightroom bug concerning the determination of whether a photo is offline.

20130905.36

Respond more gracefully when enhanced file renaming can't come up with something valid.

Added an "Ask" option to the "Export with Smart Previews?" section, so one can be alerted to the situation at each export.

Fixed the KW/KWE tables in template tokens; they had been broken when using load for the script.

20130708.35 Fixed a crash during certain file-renaming attempts where originals no longer existed.
20130630.34

When "Format" is "ORIGINAL" (meaning to spit out the original image pixels with new metadata, instead of the developed version with new metadata), the plugin didn't handle XMP sidecars properly at all. Now it does.

You now have control over the file time of exported copies (set to the image capture time, or the time of export).

20130620.33 Allow published copies to remain on disk even if a photo is deleted from Lightroom.
20130613.32 Better support for plugin revalidation.
20130612.31 A failure for the plugin to copy a file on disk resulted in a plugin crash instead of the appropriate error message display.
20130612.30

Added the ability in Lr5 to export images even if the master image file is not available, so long as there's a smart preview available.

20130611.29 Yet another Lr5 update
20130610.28 Final update for Lr5
20130513.27 More changes for the root-selection problem... really seems to be a bug in Lightroom, but it's hard to tell because I can't replicate the bug myself.
20130501.26 Update for Lr5
20130412.25 Build system update.
20130329.24

More with with the code that handles changing the root of the publish tree.

20130220.23

Added support for some new template tokens: FlagStatus (requires Lr4.1 or later), and for Lr3 and later, a bunch of IPTC extended metadata: AdditionalModelInfo, CodeOfOrgShown, DigImageGUID, Event, ImageSupplierImageId, MinorModelAge, ModelAge, ModelReleaseID, ModelReleaseStatus, NameOfOrgShown, PersonShown, PlusVersion, PropertyReleaseID, PropertyReleaseStatus, and SourceType.

20130209.22 More build-system maintenance
20130206.21 Tweak for my registration system
20121210.19 Added some extra debug logging.
20121024.18 Allow Video to be FTP'd as well.
20121009.17

Workaround for an "attempt to call field 'getProgressScope'" bug introduced in Lr4.2.

Disallow DPX video export because it breaks things.

Enhance the {EMPTY} template token so that it interrupts the squelching of superfluous joining characters.

20121004.16 Oops, the file-extension thing got worse, not better... reverting that change.
20121003.15

Work around a "situation" (likely Lr bug) where exported video loses its file extension.

More debug logging for the elusive "no root folder" problem.

20120821.14

Updates to the environment in the {LUA} token (in the template tokens in my plugins) to include photoTime() and currentTime(), and other changes to match the updated docs at that link.

.
20120810.13 Added some debug logging to try to track down an error
20120722.12 More debugging for the "choose a root folder" bug that seems to still affect a few folks.
20120531.11 Oops, I was moving the original XMP file (when the Publish format was "Original" instead of copying it. Fixed.
20120529.10

Finally tracked down why the plugin had problem with Windows network shares. Ended up filing three separate bug reports with Adobe, but in the end was able to work around the bugs, so hopefully it's working now.

Update to handle the Mac App Store version of Lightroom.

20120510.9

Tweak for Lr4.1RC2.

Added the ability to move/reset the root folder. As a byproduct, this should allow the "choose a root folder" situation to be repaired.

In some crazy file-renaming situations, the plugin could get confused about the file extension.

Enhanced the send-log dialog to hopefully make reports more meaningful to me, yielding, I hope, the ability to respond more sensibly to more reports.

Added to the template tokens supported by the plugin: {FullMasterFile}, {FullMasterFolder}, {FullExportedFile}, and {FullExportedFolder}

20120330.8 Update to handle 4.1RC
20120315.7 Add some extra debug logging to try to track down some network-folder errors.
20120309.6

Update to the debug logging to better track down timing issues that might arise.

20120228.5

Wasn't handling some kind of file-rename templates properly.

Now handles things much more gracefully when some files are offline when the publish is started.

Better support for video in Lr4.

20120224.4 A few bug and Lr4 fixes, and some extra debug logging.
20120217.3 Didn't handle XMP sidecars correctly when publishing original raw files.
20120217.2 Discovered why "metadata that triggers a republish" wasn't reliable, and fixed it.
20120213.1 Initial release, evolving from my earlier tree-publisher plugin, which dated back to the summer of 2010.

The 30 most-recent comments (out of 235; see all), most recent last...

Hi Jeffery,
Please ignore my previous message, I found that mark as up-to-date is only available on photos under the modified banner, which is sensible, so all sorted.
Your folder publisher is a great, and it is an essential part of my workflow, so thank you for making it available and maintaining it.
Regards,
Paul

— comment by Paul Johnson on April 22nd, 2020 at 10:55pm JST (1 year, 6 months ago) comment permalink

Hi Jeffrey,

Thank you so much for developing the Folder Publisher Plugin. It is perfect for my workflow and generally working very well.

I have just been running into one small issue. While the majority of what I publish is photos, I have a few video files that are amongst them. When I run the publisher, as soon as it gets to a video file, it publishes it correctly but then seems to freeze and be unable to publish the remaining photos or videos. In fact, I can cancel the publish operation and even when I click publish again it does nothing. When I restart lightroom it works perfectly until it reaches another video file when the same issue repeats. The video files are just short (usually less than 10 seconds) .mp4 files.

Have you ever run across this issue before or is there something which you think I may be doing wrong.

Thanks again for all your hard work,
Chris

Ps. writing from the UK

Are you sure that there’s not a larger video in there? Lightroom can seem to be locked up for hours on end when it’s trying to export a large video. —Jeffrey

— comment by Chris on April 25th, 2020 at 2:01am JST (1 year, 6 months ago) comment permalink

When I change the name of a FOLDER, the mirrored folder hierarchy does not update, nor does the new (i.e. renamed) folder propagate to the mirrored set. Is this the expected behavior? If so, is there a suggested work-around?

Thank you for your excellent plug-ins.

Regards,
Art

It’s expected, but, of course, not great. It’s all very kludgy under the hood, as Lightroom doesn’t provide many hooks here. If you make a folder name change, you’ve got to deal with changes to mirrored items manually. —Jeffrey

— comment by Art Held on April 26th, 2020 at 11:44am JST (1 year, 6 months ago) comment permalink

Hi Jeffrey,
Thank you so much for this very useful plugin!
Is it somehow possible to publish only one single image or a selection instead of publishing the whole collection?
In my case I’ve created a jf folder publisher collection for every year to separate them and keep it rudimentary overseeable, to have a mirror of my library as jpgs on my harddrive. So if I there are a lot of images waiting for the publish, I don’t see any way to get a certain folder exported / published prior to the rest.
Do you have any tip for me?
Thanks
Steffen

Select the thumbnails to publish and hold down the alt/option key to change the [Publish] button into [Publish Selected], and click… —Jeffrey

— comment by Steffen on April 26th, 2020 at 7:14pm JST (1 year, 6 months ago) comment permalink

Hi Jeffrey,

I am a long term fan of you plugins!
I just encountered an issue with file naming if I publish a smart collection including photos with virtual copies. Sometimes the master photo will not be published with the correct name or even worth a “-x” gets added where x is e.g. a number increased from the last published version of the file.
I also use MetaDataWrangler for the publishing service.
If you need anything to dig further in the details just let me know. Any help is appreciated.

Thanks

Heinfried

Lightroom adds the “-#” suffix if any of the filenames in a current publish would conflict (which is what would happen if you have virtual copies and a file nameing pattern that doesn’t differentiate). The plugin adds the “-#” suffix if there would be any conflicts with any previously-published image. You can avoid Lightroom’s “-#” suffix by using the plugin’s “Extended File Renaming” feature. —Jeffrey

— comment by Heinfried on May 17th, 2020 at 7:56pm JST (1 year, 5 months ago) comment permalink

Hi Jeffrey,

Firstly, great work, the plugins you provide are awesome and appreciated!

I have an issue with this folder publisher plugin however. I have source and destination on D: (Raid 10 array). Lightroom and its catalogue are stored on C: (SSD). Whenever I run the plugin for a large collection it has continual high throughput on the SSD and completely fills it (right up to 0 bytes free). This seems to be due to LR Preview Cache. Both the filling of the SSD (main concern) and very high SSD usage/throughput (secondary concern) seem unnecessary. Is there some way to avoid this occurring?

Thanks,
Fraser

Unfortunately, this is all Lightroom’s doing. The plugin accepts the files as Lightroom produces them, and moves them to their destination right away. The plugin takes almost no time to do this, so it should always be caught up with what Lightroom is producing (and just in case, the plugin tells Lightroom not to work too far ahead), so this buildup, which I’ve heard of before, makes no sense to me. I suppose you could reduce the size of your Camera Raw Cache (see the Performance tab of Lightroom’s settings), and perhaps that would help??? —Jeffrey

— comment by Fraser on June 1st, 2020 at 10:59am JST (1 year, 5 months ago) comment permalink

Hi Jeffrey – thank you for your prompt reply!

I’ve managed to track down where the build up is located, it’s in one of the temp folders (located in C:\Users\xxx\AppData\Local\Temp) that seems to contain photos being published (i.e. the post conversion photo). It’s in a folder with an alphanumeric string but no {} around it like the others in there. The number of photos in there is constantly moving but overall tracking up whilst CPU load is max and only tracking down once CPU load drops (presumably once all the JPEGs have been created) the number just tracks down.

Incidentally, I note your log file for the folder publish running right now is up to 95mb and increasing slowly.

Does that give you any ideas or help narrow it down? 🙂

I’ve pushed out a new version of the plugin that includes some extra debugging. I’ll ask, please, to install the new version, turn on the “enhanced debug logging” feature in the Plugin Manager, start a big publish operation and let it go for a while, then send the log and I’ll take a look. (Note that I found a bug in Lightroom whereby it continues publishing even after the publish operation has been canceled, filling up that temporary folder that should have been deleted. So you may want to shut down Lightroom after sending the log, then manually go and delete that temporary folder.) Thanks! —Jeffrey

— comment by Fraser on June 2nd, 2020 at 12:08pm JST (1 year, 5 months ago) comment permalink

Hi Jeffrey

I’m evaluating your folder publisher plugging as I hope it will solve a problem for me. I realized that it handles paths case *in*sensitive (I use version 20200516.108 on Lightroom Classic version: 9.2.1 [ 202004070813-7699d98a ]). As I am on MacOS (which has a case-sensitive filesystem), this worries me because it can cause filename collision in the published catalog that were not there (obviously) in the original file tree. I see these things that could happen:

1. inter-drive collision

Some files on (drive)/pictures/…
Some files on (other drive)/pictures/…

=> jfFP merges those into the same dir (published)/pictures

I don’t see a way how to fix this except for renaming the directory on one of the drives. This happens to me because I have pictures in my home folder under “pictures” and pictures on my NAS in the folder “pictures”. One solution is to make a trivial change in (one of) the directory names. But this could lead to issue 2:

2. case collisions

The above-mentioned problem still happens to me in this case:

Some files on (drive)/Pictures/…
Some files on (other drive)/pictures/…

(note the capital “P” in “Pictures”)

Published files are all stored inside a single folder named “pictures”. I expect two folder: “Pictures” and “pictures”.

=> I consider this a bug in jf FP. Could you do something about it?

I expect that this will also happen for directories (or filenames) on the same drive. I worry that

a) not all fotos are published (some fotos are overwritten)
b) oscillations or other strange behaviour will start. Such as when I change the original of the overwritten file. This will probably trigger a republish of that file which will replace the overwriting file with the previously overwritten file which could in turn (maybe) trigger a re-publish of the other file. and so on.

And if I may ask: Will I also have to worry about special chars (such as spaces or Umlauts) in pathnames?

Best regards,
Adrian from Switzerland

MacOS can support a case-sensitive file system, but its default is case insensitive, and you’ll have real problems trying to run any Adobe product on a case-sensitive file system. I speak from experience. As for name conflicts, the plugin will handle them properly and files won’t get overwritten… unique photos with shared names will get unique names (e.g. “foto.jpg” and “foto (2).jpg”). Lightroom itself had a bug WRT this, but it was fixed in the version that you have. —Jeffrey

— comment by Adrian on June 4th, 2020 at 4:34am JST (1 year, 5 months ago) comment permalink

> Added the ability to find missing published photos and have them marked for republish.

Is this a function menu or button somewhere?

Yes, in the “Publish Tree” section of the publish-service settings dialog. —Jeffrey

— comment by Chris on June 10th, 2020 at 12:43am JST (1 year, 5 months ago) comment permalink

Hi Jeffrey,

Coming in from Vancouver, Canada! Thanks for this plugin, it’s a much-needed tool! Your work is awesome!

I’m running into problems with HEIC files. I have several that came from my wife’s iPhone. None of them successfully exported using this plugin. They produced log messages like this:

Filename = “IMG_7219.HEIC”
full_master_info = table:
| fileCreationDate = 622790008
| fileCreationDateTimezoneOffset = -25200
| fileModificationDate = 622790008
| fileModificationDateTimezoneOffset = -25200
| fileSize = 1654062
full_master_path = “REDACTED/IMG_7219.HEIC”
i = 75859

plugin processing time since prior render finished: 1.0 sec
render wait time: 0.0 sec

folder-publisher#109 +112137.6>041117 [x600005859388] @TreePublisher_Main line 204: result of waitForRender()
—————————————————————-

isVirtualCopy = false
master = “REDACTED/IMG_7219.HEIC”
rendered_image_attribs = empty table
rendered_image_fullPath = “openNegative: dng_error_bad_format”
success = false
viaMaster = false

I don’t have any other problems with these HEIC files, so I was wondering if it might be a problematic assumption about what’s in them?

Thanks for any help you might be able to provide!

(Also, would love to sync with you about some Lightroom-related tools I’m interested in building myself.)

Cheers!
Thad

The “dng_error_bad_format” error is coming from deep within ACR (which itself is deep within Lightroom)… it’s having trouble reading that file. Is it possible that file’s in a folder that’s something other than standard, such as on a remote server, or a Dropbox folder? This could explain intermittent issues. (For your tools questions, please email. —Jeffrey

— comment by Thad Hughes on June 30th, 2020 at 5:15am JST (1 year, 4 months ago) comment permalink

As a heads up for others, this plugin in not compatible with Lightroom Classic 10, getting errors:

Sorry about the delay… I pushed out new versions a few hours after Lr10 was announced. —Jeffrey

— comment by Jonathon on October 20th, 2020 at 10:59pm JST (1 year ago) comment permalink

After upgrading to LC Classic v10.0, I had to do a fresh re-install of this plug-in. All fine except that I’m not seeing the “Mark as published” option anymore when I right-click with images selected. Without that option, I would have to re-publish my 20K+ old images. I hope I don’t have to do that. Any help? Thanks.

Lightroom allows the “Mark as Published” option only in the “Modified Photos to Re-Publish” section. Upgrading to Lr10 shouldn’t have required re-creating the publish services, but if you did recreate the publish services, you’d have to publish all as if starting from scratch, because that’s what creating a new publish service is. (On the other hand, simply re-installing the plugin files should have no effect on any of this.) —Jeffrey

— comment by Michael on October 27th, 2020 at 7:24am JST (11 months, 30 days ago) comment permalink

I have same issue as Chris from 25 April. Publisher works for a while but then seems to freeze and will not publish the remaining photos or videos. When I restart Lightroom (6.9, on Windows 10) it works for a while but eventually halts, or rather, Lightroom reports (when I try to quit) that a process is still going– I decide to wait it out but nothing happens and I mean 1-2 days later. Chris and others report issues on videos – could be, I have included videos in the Publish but they have been making it through to the backup disk and look fine (better than in Lightroom, which for some reason has taken to previewing videos with a hideous green cast).
The only clue I can add is that the CPU is in fact churning away, 70-80% via a process called amecommand.exe. Next morning it’s still going but by afternoon amecommand.exe has disappeared from Task Manager, and no CPU/disk/memory activity – though Lightroom still warns me upon quit that an (unspecified) process is still going. amecommand.exe is reported to be part of LR, though no one quite knows what it does.
So there you have it. I’ll keep pressing ahead, Publisher seems to make a little more progress each time I restart so perhaps I can eventually make a backup of the entire photos directory… and much easier than doing it manually. For which, thanks. But naturally I’ll check whether some could be missing.

I’ve no idea what “amecommand.exe” is, but these kind of delays are almost certainly videos. If it’s something that works with your workflow, you can have the original video file copied as the exported video (by setting the video format to “ORIGINAL”). Since Lightroom doesn’t have to render it, it’s as quick as a file copy. —Jeffrey

— comment by Michael on October 30th, 2020 at 6:19pm JST (11 months, 26 days ago) comment permalink

Hi,
I heavily rely on “custom sort” ordering my pictures in Lightroom’s folders (I am not using collections) by dragging pictures among one another in Lightroom’s grid view. Is there a way to have the output filenames reflect this custom ordering?
Built-in Lightroom renaming features, as well as “AbsSequenceFirst” (and the likes), always generate a numbering that has the same order as the original files ordering, even if my custom sort is different.

Thanks (and congrats for this great plugin!)

The very first time that a publish-collection is published, the order of the photos in the publish collection should be reflected in the output filenames, but once files start getting added and deleted, the sense of order can get lost. —Jeffrey

— comment by Jérôme on November 19th, 2020 at 7:23am JST (11 months, 7 days ago) comment permalink

Jeffery, your http (i.e. not https) addresses don’t now play well with some browsers (eg Firefox) which have options for requiring https sites. FYI. … David

Yeah, I’ve heard. Those browsers shouldn’t be doing that. I’ve had separate content on the two servers for two decades; it’s not appropriate to assume that they’re the same. —Jeffrey

— comment by david on December 17th, 2020 at 9:38pm JST (10 months, 8 days ago) comment permalink

Is it possible to use template tokens in the elements of the path which will be prepend or append to the root path as provided in a given collection settings? I tried to use {YYYY} , but this template was not resolved into actual years when I kicked off publishing. What is wrong? Thanks!

No, sorry, template tokens are not supported there. I wanted to have them supported, but I ran into some technical problems in how Lightroom allows plugins to access photo data, and wasn’t able to resolve them. )-: —Jeffrey

— comment by Vladimir on December 30th, 2020 at 1:42am JST (9 months, 27 days ago) comment permalink

I want to report a bug with unicode folder names, and feature of setting file date.
To reproduce:
– Publish a video file that reside in folder that contains unicode characters (I suppose it also reproduces with jpeg).
– In publish settings, select “Explicitly set date to photo capture date”
– The exported file will get current date set as file creation date.
– In log, there appears error with “setdate: bad arg pair time”, I suppose due to file name.
Will be grateful if you look at it.

log = “Start of execution
ARG[1451046154]
ARG[D:\Pictures.publish\My Photos\2015-12-25 ???? ??????\MVI_0155.mp4]
No conversion needed for: D:\Pictures.publish\My Photos\2015-12-25 ???? ??????\MVI_0155.mp4
d:\Pictures\Lightroom\Plugins\folder-publisher-jfriedl.lrplugin\setdate: bad arg pair time[1451046154] file[D:\Pictures.publish\My Photos\2015-12-25 ???? ??????\MVI_0155.mp4]

status = 1

Can you send the full plugin log, as described here? Thanks. —Jeffrey

— comment by Roman on January 5th, 2021 at 3:11am JST (9 months, 21 days ago) comment permalink

I have problems to publish my photos of a sub-folder in the same personalized order, when I select different origins. I mean, I select for publication the folder of the year, with different months and topics inside. The customized order of my photos in each topic is lost during publication.
Is there some way to keep the photos in my custom order?
Thank you very much.

It’s almost impossible. The plugin publishes photos in the order that they’re presented in Lightroom, but the ordering that the copies are made for local disk is not usually reflected in how the OS (Finder or Windows Explorer) presents photos in a folder. Usually it’s done via filename sort, so if you arrange for output filenames that sort in the same order as the order you want, it’ll work, and this is pretty easy using the “Extended File Renaming” tools of the plugin, but then it all falls apart once new photos are added, since the plugin won’t rename older photos to account for the reordering. It’s a tough nut to crack. —Jeffrey

— comment by Federico on January 19th, 2021 at 8:33pm JST (9 months, 6 days ago) comment permalink

Hello,

I sent a message before but I’m not quite sure if you got it. Using the watch folder system. Can I have one file go in and export the same file but with many different profiles applied to that one photo.

So another words. One photo goes in. 20 photos come out and each photo has a unique profile apply to it.

Thanks

No, sorry, I can’t think of any way to do this. You’d need to make 19 virtual copies, apply the develop presets to them, and somehow (perhaps via keywords and smart collections?) get them into different publish collections for export. It might be possible with a custom plugin, but I’m not sure. —Jeffrey

— comment by Author on January 27th, 2021 at 7:59pm JST (8 months, 29 days ago) comment permalink

Is there a possibility to publish multiple folder trees with different image sizes? An example would be a full size export + a 4k export for quick browsing. Lightroom 9 introduced something called multi-batch exports – I wonder if that can work with a publisher plugin like this

Thanks for a great plugin, much better than anything else

You can do this by setting up multiple Publish Services, with the only difference between them the different image-size settings. It’d be nice if one publish service could do multiple sizes, but Lightroom doesn’t allow for it. —Jeffrey

— comment by Ashish on January 29th, 2021 at 1:03am JST (8 months, 28 days ago) comment permalink

Hi Jeffrey,

first of all – thanks for your work, the Folder Publisher plugin is exactly what I have been looking for.

However, after a few successful runs with small data sets it failed when I tried to apply it to a collection of ~25K items. It only published the very first item (which was a video incidentially) and then kept running and running without adding new items to the target folder on my external drive. It kept adding new converted items to the internal temp folder, however – I stopped the publishing process when this folder reached 1.3K items / 11.3GB. The temp folder name is a UUID without the enclosing {} that most other folders have.

I am running LR 6.14 on Windows 10. The issue seems very similar to the one Fraser reported on 2020-06-02. Did you find a solution for that one?

Thanks,
Martin

I’m going to guess that the 2nd item is a video that the system is crunching away on at the same time that less-crunch things are being generated by other threads. Lightroom can take a VERY long time on videos….days. Perhaps try without videos first? As for the buildup, the plugin instructs Lightroom to not render so far ahead, but Lightroom seems to ignore it. (If trying again without videos doesn’t solve it, perhaps send a plugin log with another recap once it’s gotten into that stuck state.) —Jeffrey

— comment by Martin on March 15th, 2021 at 3:20am JST (7 months, 11 days ago) comment permalink

Hi Jeffrey,
I’m facing the same issue as http://regex.info/blog/lightroom-goodies/folder-publisher#comment-60302 since now several months. I’m not really able to export my folders since the export process stucks after the 1st or 2nd file.
I do have photos & videos. But I don’t understand the fact that this is a pure lightroom issue. If within lightroom I export a heavy video it does it within 10 seconds and 3 minutes, my computer including video card is optimized for photos & videos.
In this very precises moment, the plugin is running for 14 hours and still blocked (not sure if it’s blocked in the 1st or 2nd file), the log file timestamp of Folder Publisher hasn’t changed since now 13 hours. And Lightroom is using 0.3% of CPU. Overall my computer is using 2% of CPU. And I still have 10GB of free RAM out of 32GB.
I made a further test. I checked in the log file what is the last filename of a photo or video. It was a video, let’s say “video.m2ts”. Without stopping Folder Publisher export, I exported the video video.m2ts usinf File -> Export in Lightroom and it took 10 seconds.
What else can I do to troubleshoot ?
I’m using LR Classic 10.2 and plugin 20210302.114 (I upgrade regularly to see if the issue is solved).
Many thanks and kind regards,
Rafael

— comment by Rafael on March 26th, 2021 at 4:44pm JST (7 months ago) comment permalink

Greetings from North Carolina – your plugins are life-savors (zenfolio, geotag, folder pub).

Still using 6.14.

I think there’s a problem with recent version of Folder Publisher (20210302.114) as it no longer preserves the original file creation date no matter how it is set in the settings menu. Explorer shows it as the current date and time. Folder set is created on a Synology NAS which confirms what Explorer shows.

Reverted back to 20201103.111 which works just fine. Looking at my files it seems to have changed after December 25. Also shows that I installed two updates since then (20210116.112 and 20210211.113) but I have not checked them to see what they do (but I can if it’s helpful).

Would you mind sending a plugin log with .114 after a failure to set the time? Thanks. —Jeffrey

— comment by William Birkemeier on March 28th, 2021 at 1:56am JST (6 months, 29 days ago) comment permalink

Just downloaded / installed Export Publisher in LR Classic R10.2 and pointed Plugin Manager to the folder-publisher-jfriedl.lrplugin folder. The Plugin Manager shows the plugin and related graphics, but the new plugin is not displayed in the Export To drop-down list. Restarting LR and reinstalling the plugin didn’t resolve the issue.

What steps did I miss?

Thx –don

That plugin is a Publish-only plugin; it’s not applicable to Export. You’ll find it in the Publish panel, in the lower-left of Library. —Jeffrey

— comment by Don on April 2nd, 2021 at 4:08am JST (6 months, 24 days ago) comment permalink

Dear Jeffrey

A few days ago I’ve sent a message regarding the issue http://regex.info/blog/lightroom-goodies/folder-publisher#comment-60302.

I’ve done a few more tests for troubleshoot. Among all the tests I’ve done, here you are one that could help : a run was blocked for more than 24 hours on a single video. I stopped and restarted then 5 times, and it still was blocked on the same video. I had then the idea to remove the files from the jFolder Published collection, and add them again. I ran well, less than 10 seconds per video.
It seems then than sometimes a file stay in a wrong state in the plugin. Removing the files and adding them again solves the issue. Until next time, of course.

If I can investigate further please let me know.

Best
Rafael

That’s some good sleuthing. Unfortunately, the “stuck” is happening within Lightroom itself, and not the plugin, so there’s not much I can do. If you can replicate the problem in a small catalog, perhaps you could send it to me so that I can try to replicate it here (or send it to Adobe so that they can replicate it, which would be the ideal way toward a solution). —Jeffrey

— comment by Rafael on April 3rd, 2021 at 5:36am JST (6 months, 23 days ago) comment permalink

Please setup your https:// website redirection – modern Firefox (86)+ forces https – and your website can no longer be accessed as that is just a blank holding page!

Try turning “HTTPS-Only Mode” off. HTTP and HTTPS servers are separate, just like HTTP and FTP, so blindly assuming that they are the same seems ridiculous. I’ve had separate trees on them for two decades and merging them is not reasonable. —Jeffrey

— comment by user on April 5th, 2021 at 11:55pm JST (6 months, 20 days ago) comment permalink

Hello Jeffrey,
I have been using the plug in LZA HDD TREE for many years. It has not been supported for a long time, but it still works with Lightroom Classic.
I would like to use your Folder Publisher as it has some very good features. For example, the scan for changed file names and folders.

What I personally miss and what is important for me would be the option of LZA HDD TREE to delete leading folders. E.g. to export the folders and files in D:\Pictures\2021\Africa to the existing folder “Pictures” on a network share. This must then look like \\server\Pictures\2021\Africa.
The export path must therefore be shortened by “1” directory. The number is selectable.

LZA offers an extensive selection of metadata fields, which should cause or prevent a new publication. This is very helpful.

Do you know LZA HDD TREE. If not, please write me how I can send it to you. It can no longer be found on the internet.

Best regards
Rainer

Translated with http://www.DeepL.com/Translator (free version)

Folder Publisher can ignore leading components: it’s an option on the “Create Collection” dialog. —Jeffrey

— comment by Rainer on April 23rd, 2021 at 6:50pm JST (6 months, 2 days ago) comment permalink

Good morning Jeffrey,

Your Folder Publisher Plugin works very nicely for me and I have 50k+ pics. So to maintain full functionality going forward, I tried to register the “Folder Publisher” Lightroom plug-in and received an error saying “The plugin is not able to contact Jeffrey’s server”. I am sure I have internet connectivity from my machine, and I am hoping you can help me complete the registration now that I have donated 😉

Thank you.

Best,
Peter

Perhaps it was some kind of temporary problem between you and me? Or, as per this FAQ, it could be some kind of security app on your system blocking Lightroom. I’ve had no other reports of problems recently…. —Jeffrey

— comment by Peter G Maier on July 11th, 2021 at 10:16am JST (3 months, 15 days ago) comment permalink

Hi,
another one from me:
I use the Folder Publish plugin to automate exporting images for my clients. I have a hierarchical keyword tree in the fashion of META > customer > Jeffrey for that.

Using the enhanced Renaming Feature of this plugin, I use that Keyword to create the directory path, where the export should be stored:
{Keywords:ChildOf=customer}/{FolderName}/{PublishServiceTitle}/{FILENAME}
resulting in the image being stored as,
Export Folder/Jeffrey/20210713 Fancy Job/Web/Super Cool image 1234.jpg

Sometimes it happens, that I sell an image to multiple customers. In in that case, I’d like to be able to just tick another box for another keyword, re-publish some collections and everything is fine, say I add META > customer > ABC News.

Currently, the Keyword Token takes all keywords that the filter applies to and creates a comma separated list of them. Because of that, images with multiple customer keywords are exported as
Export Folder/ABC News, Jeffrey/20210713 Fancy Job/Web/Super Cool image 1234.jpg

It would be really cool, to have a second keyword token that behaves differently. Instead of returning a string containing all possible keywords, it would create an array of exports to make, like

Export Folder/ABC News/20210713 Fancy Job/Web/Super Cool image 1234.jpg
AND Export Folder/Jeffrey/20210713 Fancy Job/Web/Super Cool image 1234.jpg

Is Lightroom capable of doing this? It might be better to not export the image multiple times, but to export it once and then copy it.

You might be able to handle this with my Run Any Command plugin, if you can write a program that looks at the image metadata and can detect that it should have been written out to multiple places, and then make the appropriate copy/copies. —Jeffrey

— comment by Leo on July 14th, 2021 at 12:59am JST (3 months, 12 days ago) comment permalink

Hi there, sorry to bother you. I’ve been using folder publish for years, on huge libraries (180k pics) with no problems.

No I have this error that can’t fix. I did everything:

“Cant update this collection.” warning window, with a file name (always video file, which I don’t include in the exports) and “it doesn’t seem to exist”.

And it halts.

Would you mind sending the plugin log when you next encounter this error? Could it be that the video is somehow included in the publish without you realizing it, such as being hidden inside a stack? —Jeffrey

— comment by Guillermo on July 17th, 2021 at 1:40am JST (3 months, 9 days ago) comment permalink
Leave a comment...


All comments are invisible to others until Jeffrey approves them.

Please mention what part of the world you're writing from, if you don't mind. It's always interesting to see where people are visiting from.


You can use basic HTML; be sure to close tags properly.

Subscribe without commenting