I would like to know how to use S3 wrt. isolation between tags, between APIs, in a recommended way.
Why do I see
c3/c3as tenant/tag in the result of
FileSourceCollection.get("<some canonical>").inboxUrl()? (I have curled to
/fileAPI using my tenant/tag)
Why are files curled via
/importseen in the same S3 directory/ FileSourceCollection?
It seems that
SourceFileis not marked as completed when a file is curled via
/importbut then it gets reprocessed upon
syncAll(fsc.inboxUrl()): am I wrong or how should this be reconciled? (My coworker curled file1 to
/importwhile I was testing
SourceFileAPIs with file2 of the same canonical. When I called
syncAll, file1 was reprocessed. I don’t know at the moment if he used the same tag as myself.)
inboxUrl()returning a physical url or what is visible is actually tag/tenant-isolated?
What is the right way to deal with the usual case of integrating data per canonical? There is one
FileSourceCollectionper canonical, but
SourceFileseems not so connected to canonicals. Is there a better/safer way to synchronizing per canoncal than manually (file by file from a
FileSourceCollectionor via tricks like
@garrynigel suggested configuring with
and asking the Ops about details.