[RESOLU] BM3 - impossible charger le serveur par un Imapcopy

Bonjour à tous,

je suis entrain de mettre en production un nouveau serveur BM v3.
Impossible de charger la tonne de mail par un Imapcopy …

Avez vous eu déjà le cas ?
test en cours de mon imapcopy sur un serveur de dev, en 2.0.13, pas de soucis pour le moment …

Voici les erreurs

---------------------------------------------------------------------------
2014.03.26 18:13:35 LOG5[24535:139932888229632]: stunnel3 accepted connection from 127.0.0.1:54611
2014.03.26 18:13:35 LOG5[24535:139932888229632]: connect_blocking: connected 5.39.21.236:993
2014.03.26 18:13:35 LOG5[24535:139932888229632]: stunnel3 connected remote server from 37.59.123.71:38797
2014.03.26 18:13:35 LOG5[24536:139979236189952]: stunnel3 accepted connection from 127.0.0.1:57169
2014.03.26 18:13:35 LOG5[24536:139979236189952]: connect_blocking: connected 94.23.97.230:993
2014.03.26 18:13:35 LOG5[24536:139979236189952]: stunnel3 connected remote server from 37.59.123.71:36814
Login on sourceserver as daniel.ferey@df2ce.fr OK
Login on destinationserver as test2-daniel.ferey@df2ce.fr OK
Getting folderlist on sourceserver OK, found 39 folder
Creating Rootfolder Ancien_Mail
Getting List of messages in "INBOX" OK, 3741 Messages found
Processing Folder INBOX
Error saving message 74, continuing copy, Server returned " Error 1 receiving data from server ]"
Error saving message 75, continuing copy, Server returned ""
Error saving message 76, continuing copy, Server returned ""
WRITING
root@mail:/var/log# tail -50 /var/log/mail.err 
Mar 25 19:31:49 mail cyrus/master[5973]: setrlimit: Unable to set file descriptors limit to -1: Operation not permitted
Mar 25 19:31:49 mail cyrus/master[5973]: retrying with 4096 (current max)
Mar 25 19:31:50 mail cyrus/tls_prune[5983]: DBERROR: opening /var/lib/cyrus/tls_sessions.db: cyrusdb error
Mar 25 19:31:50 mail cyrus/master[5973]: process 5983 exited, status 1
Mar 25 19:36:31 mail cyrus/master[1297]: setrlimit: Unable to set file descriptors limit to -1: Operation not permitted
Mar 25 19:36:31 mail cyrus/master[1297]: retrying with 4096 (current max)
Mar 25 19:36:32 mail cyrus/tls_prune[1324]: DBERROR: opening /var/lib/cyrus/tls_sessions.db: cyrusdb error
Mar 25 19:36:32 mail cyrus/master[1297]: process 1324 exited, status 1
Mar 25 19:39:48 mail cyrus/notify[1326]: recvfrom failed: Interrupted system call
Mar 25 19:39:50 mail cyrus/master[4658]: setrlimit: Unable to set file descriptors limit to -1: Operation not permitted
Mar 25 19:39:50 mail cyrus/master[4658]: retrying with 65536 (current max)
Mar 25 19:39:52 mail cyrus/notify[4670]: recvfrom failed: Interrupted system call
Mar 25 19:39:52 mail cyrus/master[4713]: setrlimit: Unable to set file descriptors limit to -1: Operation not permitted
Mar 25 19:39:52 mail cyrus/master[4713]: retrying with 65536 (current max)
Mar 26 14:07:29 mail cyrus/notify[4726]: recvfrom failed: Interrupted system call
Mar 26 14:07:29 mail cyrus/master[4980]: setrlimit: Unable to set file descriptors limit to -1: Operation not permitted
Mar 26 14:07:29 mail cyrus/master[4980]: retrying with 65536 (current max)
Mar 26 14:09:10 mail cyrus/notify[4994]: recvfrom failed: Interrupted system call
Mar 26 14:09:11 mail cyrus/master[5431]: setrlimit: Unable to set file descriptors limit to -1: Operation not permitted
Mar 26 14:09:11 mail cyrus/master[5431]: retrying with 65536 (current max)
Mar 26 14:11:54 mail cyrus/notify[5443]: recvfrom failed: Interrupted system call
Mar 26 14:11:54 mail cyrus/master[6508]: setrlimit: Unable to set file descriptors limit to -1: Operation not permitted
Mar 26 14:11:54 mail cyrus/master[6508]: retrying with 65536 (current max)
Mar 26 15:01:30 mail postfix/postfix-script[13143]: error: unknown command: 'restart'
Mar 26 15:01:30 mail postfix/postfix-script[13144]: fatal: usage: postfix start (or stop, reload, abort, flush, check, status, set-permissions, upgrade-configuration)
Mar 26 17:04:51 mail cyrus/imap[26328]: IOERROR: reading message: unexpected end of file
Mar 26 17:37:58 mail cyrus/imap[28558]: IOERROR: reading message: unexpected end of file
Mar 26 17:53:52 mail cyrus/imap[1568]: IOERROR: reading message: unexpected end of file
root@mail:/var/log# 

root@mail:/var/log# tail -50 /var/log/bm/core.log 2014-03-26 17:17:00,281 n.b.c.j.i.JobBindingImpl INFO - getJobFromId EventAlert 2014-03-26 17:17:00,281 n.b.c.j.i.JobHome INFO - Loaded 1 jobs from database. 2014-03-26 17:17:00,281 n.b.c.s.m.MemorySessionStoreFactory INFO - MQ: logout eb1e7b77-1969-4bc4-a0b0-c8a8c5ab3356 sent. 2014-03-26 17:17:00,284 n.b.c.s.m.MemorySessionStoreFactory INFO - MQ: logout 391251e3-d059-4450-a113-27ac1e719c87 sent. 2014-03-26 17:17:00,285 n.b.c.s.m.MemorySessionStoreFactory INFO - MQ: logout 2f111b08-f84c-4d97-bf6c-da62477ec3bd sent. 2014-03-26 17:17:00,286 n.b.c.j.i.Scheduler INFO - Finishing EventAlert-global.virt-1395854220282 2014-03-26 17:17:00,286 n.b.c.j.i.Scheduler INFO - [EventAlert-global.virt-1395854220282] progress is now 100%. 2014-03-26 17:17:00,286 n.b.c.j.i.ExecutionRecorder INFO - recording execution of EventAlert-global.virt-1395854220282 2014-03-26 17:17:00,286 n.b.c.j.i.JobHome INFO - recording execution for EventAlert-global.virt-1395854220282... 2014-03-26 17:17:00,287 n.b.c.j.i.JobBindingImpl INFO - getJobFromId net.bluemind.archive.core.ArchiveJob 2014-03-26 17:17:00,287 n.b.c.j.i.JobHome INFO - run plan for EventAlert@global.virt updated with last_run set to id 3974 (start: Wed Mar 26 17:17:00 GMT 2014) 2014-03-26 17:17:00,287 n.b.c.j.i.JobHome INFO - saving 3 entries... 2014-03-26 17:17:00,288 n.b.c.j.i.JobHome INFO - Loaded 0 jobs from database. 2014-03-26 17:17:00,288 n.b.c.s.m.MemorySessionStoreFactory INFO - MQ: logout d60d5f8a-ada2-41da-a6f4-0611679ace57 sent. 2014-03-26 17:17:00,288 n.b.a.c.ArchiveJob INFO - not forced, last run was 81420secs ago. 2014-03-26 17:17:00,288 n.b.a.c.ArchiveJob INFO - less than one day ago, skipping execution. 2014-03-26 17:17:00,288 n.b.a.c.ArchiveJob INFO - not forced, last run was 14700secs ago. 2014-03-26 17:17:00,288 n.b.a.c.ArchiveJob INFO - less than one day ago, skipping execution. 2014-03-26 17:17:00,290 n.b.c.s.m.MemorySessionStoreFactory INFO - MQ: logout 79d57fa9-598e-4155-af97-8b04839b6284 sent. 2014-03-26 17:17:00,291 n.b.c.j.i.JobBindingImpl INFO - getJobFromId net.bluemind.job.mailindex.MailspoolUpgradeIndexSchemaJob 2014-03-26 17:17:00,292 n.b.c.j.i.JobHome INFO - Loaded 0 jobs from database. 2014-03-26 17:17:00,292 n.b.c.s.m.MemorySessionStoreFactory INFO - MQ: logout 42f44735-f7de-460f-8d1c-7604d0bbc878 sent. 2014-03-26 17:17:00,292 n.b.j.m.MailspoolUpgradeIndexSchemaJob INFO - Not planned. 2014-03-26 17:17:00,293 n.b.c.j.i.Scheduler INFO - Finishing net.bluemind.core.jobs.cleanup.JobExecutionsCleanJob-global.virt-1395854220254 2014-03-26 17:17:00,294 n.b.c.s.m.MemorySessionStoreFactory INFO - MQ: logout a308fe6f-7185-4c77-ac36-7e863c8872fc sent. 2014-03-26 17:17:00,295 n.b.c.j.i.JobBindingImpl INFO - getJobFromId net.bluemind.dataprotect.core.DataProtectJob 2014-03-26 17:17:00,296 n.b.c.j.i.JobHome INFO - Loaded 1 jobs from database. 2014-03-26 17:17:00,296 n.b.c.s.m.MemorySessionStoreFactory INFO - MQ: logout decc9d54-b473-4bef-8e8b-4cd09afe8be4 sent. 2014-03-26 17:17:00,297 n.b.c.j.i.JobRunner INFO - net.bluemind.dataprotect.core.DataProtectJob@global.virt: The fire from the sky still falls (launch date: Thu Mar 27 03:00:00 GMT 2014) 2014-03-26 17:17:00,299 n.b.c.s.m.MemorySessionStoreFactory INFO - MQ: logout e7a26614-9c95-45a3-b4ae-08434a6b9d2b sent. 2014-03-26 17:17:00,300 n.b.c.j.i.JobBindingImpl INFO - getJobFromId net.bluemind.core.jobs.quota.QuotaGatheringJob 2014-03-26 17:17:00,301 n.b.c.j.i.JobHome INFO - Loaded 0 jobs from database. 2014-03-26 17:17:00,301 n.b.c.s.m.MemorySessionStoreFactory INFO - MQ: logout 7280244e-4b0d-4208-8d61-9932f3d9e1ec sent. 2014-03-26 17:17:00,301 n.b.c.j.q.QuotaGatheringJob INFO - not forced, last run was 81472secs ago. 2014-03-26 17:17:00,301 n.b.c.j.q.QuotaGatheringJob INFO - less than one day ago, skipping execution. 2014-03-26 17:17:00,301 n.b.c.j.q.QuotaGatheringJob INFO - not forced, last run was 81472secs ago. 2014-03-26 17:17:00,301 n.b.c.j.q.QuotaGatheringJob INFO - less than one day ago, skipping execution. 2014-03-26 17:17:00,320 n.b.c.j.i.Scheduler INFO - Finishing Vacation-global.virt-1395854220278 2014-03-26 17:17:00,320 n.b.c.j.i.Scheduler INFO - [Vacation-global.virt-1395854220278] progress is now 100%. 2014-03-26 17:17:00,320 n.b.c.j.i.Scheduler INFO - [EventAlert-global.virt-1395854220282] finished and recorded: SUCCESS, duration: 4ms. 2014-03-26 17:17:00,320 n.b.c.j.i.Scheduler INFO - [net.bluemind.core.jobs.cleanup.JobExecutionsCleanJob-global.virt-1395854220254] finished and recorded: SUCCESS, duration: 7ms. 2014-03-26 17:17:06,321 n.b.c.j.i.ExecutionRecorder INFO - recording execution of Vacation-global.virt-1395854220278 2014-03-26 17:17:06,322 n.b.c.j.i.JobHome INFO - recording execution for Vacation-global.virt-1395854220278... 2014-03-26 17:17:06,322 n.b.c.j.i.JobHome INFO - run plan for Vacation@global.virt updated with last_run set to id 3975 (start: Wed Mar 26 17:17:00 GMT 2014) 2014-03-26 17:17:06,323 n.b.c.j.i.JobHome INFO - saving 3 entries... 2014-03-26 17:17:06,376 n.b.c.j.i.Scheduler INFO - [Vacation-global.virt-1395854220278] finished and recorded: SUCCESS, duration: 42ms. 2014-03-26 17:17:36,006 n.b.c.UserManagement INFO - Accepting token as password for test2-daniel.ferey@df2ce.fr in bm-hps-ping 2014-03-26 17:17:36,007 n.b.c.s.SyncServlet INFO - handler responded to login/validate in 1ms. 2014-03-26 17:17:36,043 n.b.c.UserManagement INFO - Accepting token as password for test2-daniel.ferey@df2ce.fr in ips 2014-03-26 17:17:36,044 n.b.c.s.SyncServlet INFO - handler responded to login/doLogin in 2ms. root@mail:/var/log#

Bonjour Yoann,
peut être un effet de bord du nouveau composant maison proxy IMAP en v3 qui traite tout le flux IMAP.
On traite des sujets en ce moment sur ce composant.
On revient vers toi.
A bientot

Bonjour Pierre,
merci pour ce retour rapide.
Pas de soucis, je peux ouvrir les accès à ma plate-forme en cours de montage pour test si besoin.

Crdt
Poustiquet

Bonjour,

J’ai eu un problème similaire sur la copie de mail avec imapsync, j’avais des mails dont les pièces jointes étaient supérieurs à 10mo ce qui bloqué sur le transfert.
Pour résoudre j’ai été dans gestion du système / configuration système et j’ai passer Taille maximale des messages (MiB) * sur 100mo et tout est passé correctement ensuite. (après un bmctl restart)
Au niveau des logs je n’ai pas été regarder du coup je ne sais pas si mon problème correspond exactement au votre.

Cordialement

Bonjour Torrian,

effectivement, j’ai pour habitude de changer ce quota lors de la mise en production afin de l’adapter au besoin.

je change et je test … puis , je vous tiens au courant …
Hier , j’ai plutôt cherché du coté de mon Snort.

Crdt
Poustiquet

Merçi à toi, Torrian …

Erreur bête et stupide !

copie OK …