Error with Amazon S3 Attachment Setup: Page 2

Error with Amazon S3 Attachment Setup

KevinTheJedi

I updated the pull so if you already made the changes refresh the pull request and make the new changes please.

Cheers.

rsclmumbai

KevinTheJedi I'll do this on Saturday & update you.
Thanks

rsclmumbai

KevinTheJedi
I edited the code as per https://github.com/osTicket/osTicket/pull/6544
Re-downloaded both the .phar files (storage-fs.phar, storage-s3.phar)
Tested. Got this error:

[04-Jun-2023 13:27:48 UTC] PHP Fatal error: Uncaught Error: Call to a member function getInfo() on null in phar:///var/www/html/OST-Jobs-New/include/plugins/storage-s3.phar/storage.php:25 Stack trace: #0 phar:///var/www/html/OST-Jobs-New/include/plugins/storage-s3.phar/storage.php(253): S3StorageBackend::setConfig() #1 /var/www/html/OST-Jobs-New/include/class.plugin.php(147): S3StoragePlugin->bootstrap() #2 /var/www/html/OST-Jobs-New/include/class.osticket.php(676): PluginManager->bootstrap() #3 /var/www/html/OST-Jobs-New/main.inc.php(34): osTicket::start() #4 /var/www/html/OST-Jobs-New/scp/login.php(16): require_once('...') #5 {main} thrown in phar:///var/www/html/OST-Jobs-New/include/plugins/storage-s3.phar/storage.php on line 25 [04-Jun-2023 13:28:08 UTC] PHP Fatal error: Uncaught Error: Call to a member function get() on null in phar:///var/www/html/OST-Jobs-New/include/plugins/storage-fs.phar/storage.php:137 Stack trace: #0 /var/www/html/OST-Jobs-New/include/class.plugin.php(147): FsStoragePlugin->bootstrap() #1 /var/www/html/OST-Jobs-New/include/class.osticket.php(676): PluginManager->bootstrap() #2 /var/www/html/OST-Jobs-New/main.inc.php(34): osTicket::start() #3 /var/www/html/OST-Jobs-New/scp/login.php(16): require_once('...') #4 {main} thrown in phar:///var/www/html/OST-Jobs-New/include/plugins/storage-fs.phar/storage.php on line 137 [04-Jun-2023 13:28:10 UTC] PHP Fatal error: Uncaught Error: Call to a member function get() on null in phar:///var/www/html/OST-Jobs-New/include/plugins/storage-fs.phar/storage.php:137 Stack trace: #0 /var/www/html/OST-Jobs-New/include/class.plugin.php(147): FsStoragePlugin->bootstrap() #1 /var/www/html/OST-Jobs-New/include/class.osticket.php(676): PluginManager->bootstrap() #2 /var/www/html/OST-Jobs-New/main.inc.php(34): osTicket::start() #3 /var/www/html/OST-Jobs-New/scp/login.php(16): require_once('...') #4 {main} thrown in phar:///var/www/html/OST-Jobs-New/include/plugins/storage-fs.phar/storage.php on line 137 [

By undoing the changes, the osticket applications started working again.

Please check if I've done the changes correctly or slipped up on something.

Thanks

KevinTheJedi

rsclmumbai

Definitely sounds like you didn’t make the changes correctly. I cannot replicate such issues after applying the patch.

Cheers.

rsclmumbai

Is there a new plugin version with the patched code integrated? If yes, then I could just download the latest version of the plugin and test it. Tomorrow is Saturday and the best day for me to test this.
Thanks

KevinTheJedi

rsclmumbai

Upgrade to v1.17.4 or v1.18, install the latest build of the plugin, and retest.

Cheers.

rsclmumbai

KevinTheJedi Thanks

rsclmumbai

osTicket Version v1.17.4 (ea462cb) — Up to date
Web Server Software Apache/2.4.53 (Rocky Linux) OpenSSL/3.0.1
MySQL Version 10.10.3
PHP Version 8.1.17

I have managed to do the following.

Install & enable the S3 plugin.
Configured the S3 bucket
Run the below command to move 3 attachments from File System to S3.
php manage.php file migrate --bk=F --to=3 --limit=3
It worked fine. I can see 3 records on AWS > S3.

@KevinTheJedi
How do I:

Verify if the attachments files have been deleted from the local file system?
Download the moved attachment via the ticket UI to ensure the attachments are correctly accessible.

Please advise.

Thanks

KevinTheJedi

rsclmumbai

Check the bk column in the file table to ensure it says 3. Then check to make sure there are no associated file_chunk records for the files in question. Lastly, visit the Ticket where you uploaded the file and click the link to download.

Cheers.

rsclmumbai

@KevinTheJedi - Just to clarify, what I'm asking is:

How do I find the ticket number which has the attachment ID = 63365?
How do I find the folder path for the attachment ID = 63365?

Thanks

KevinTheJedi

rsclmumbai

Attachment table should have object_id with object_type of T and that’ll be the associated thread_entry record then you can backtrack from there to find the Ticket's ID or number. We have ERDs available here.

For S3 I’m pretty sure it puts all attachments in the bucket (and folder if configured) without subdirectories. So the file key column value should be the name of the file in S3.

Cheers.

rsclmumbai

KevinTheJedi Check the bk column in the file table to ensure it says 3.
Yes. Its says 3

KevinTheJedi Then check to make sure there are no associated file_chunk records for the files in question.
KevinTheJedi Lastly, visit the Ticket where you uploaded the file and click the link to download.

How do I check this? This is where I'm stuck. How do I co-relate the columns in table ost_attachment to ost_ticket

rsclmumbai

KevinTheJedi
My Attachment table has object_type H & D only.

KevinTheJedi

rsclmumbai

Sorry it is H for thread_entry and D is for Draft.

As for the relations I provided a link to the ERDs above.

Cheers.

rsclmumbai

KevinTheJedi
I have managed to successfully setup Attachments to S3 plugin & migrated current attachments (8GB) from File System to S3.

My Filesystem still shows the Attachment folder size to be 1.7GB.

Any idea why these files are not migrating and what may be in these files?

Thanks

KevinTheJedi

rsclmumbai

Run the command manually and see what errors you get.

Cheers.

rsclmumbai

KevinTheJedi
Manually? I'm sorry I did not follow. What command should I run?

rsclmumbai

KevinTheJedi
I found another bigger issue.

Around 8 hours ago, I set my plugin configuration as below.

But when I check MySQL > "files" table, I'm seeing a few files still on the file system and not on S3.

What configuration may I be missing?

Thanks

KevinTheJedi

rsclmumbai

Sorry it’s too early for me, I didn’t notice the screenshot. Are any still set to D in db? If so they can’t be moved for some reason. Either permissions issues, missing or corrupt data, etc.

Cheers.

KevinTheJedi

rsclmumbai

Admin Panel > Settings > System > Store Attachments

This was outlined in the documentation linked earlier.

Cheers.

rsclmumbai

KevinTheJedi My bad. I thought enabling the plugin was all that was required. Apologies.
Its fixed now.
Thanks

« Previous Page Next Page »