Subfolders for .ERR files in Q directory gone in 2009?

Subfolders for .ERR files in Q directory gone in 2009? SearchSearch
Author Message
Nikos Mavrakis
New member
Username: Nmavra

Post Number: 14
Registered: 05-2007
Posted on Wednesday, July 15, 2009 - 03:00 pm:   

Hello,
We upgraded our version from NowSMS 2009RC to NowSMS 2009 on Monday. Since then I discovered that there are no more directories that store .err files are created.

Did you for some reason remove this setting or is it something that I can enable somewhere? We had around 13,000 .err files over the last 48 hours so this is something that we definitely need, *or* perhaps be able to set a time after which these ERR files are deleted.

I believe this is hardcoded to 72h if I remember correctly.
Des - NowSMS Support
Board Administrator
Username: Desosms

Post Number: 1049
Registered: 08-2008
Posted on Wednesday, July 15, 2009 - 06:37 pm:   

Hi Nikos,

Let me make sure that I understand the problem.

Are you saying that the .ERR files are still there, but they used to be in subdirectories, and now they are not?

That would be a side-effect of the change that we made to stop using so many subdirctories. We keep the .ERR file in the same directory as the original .REQ file.

There is some configurabiilty to how frequently these are cleaned up. The default is 72 hours, but it is possible to change this. Under [SMSGW] in SMSGW.INI, you can set ErrorQRetainDays=## to a number of days. The lowest value supported is 1, or 24 hours.

--
Des
NowSMS Support
Nikos Mavrakis
New member
Username: Nmavra

Post Number: 16
Registered: 05-2007
Posted on Thursday, July 16, 2009 - 08:50 am:   

Yes this is what I mean, in our case we get around 10,000 error files a day, so 1 day is ok for us for the time being.

I do however believe that the previous version is more convenient because we had no worries about the number of files in this folder since sub folders were being created (and we usually got 2 or 3 subfolders full of err files daily).

A combination of the two would be great, but for the time being we'll be fine with ErrorQRetainDays=1 :-)
Des - NowSMS Support
Board Administrator
Username: Desosms

Post Number: 1052
Registered: 08-2008
Posted on Friday, July 17, 2009 - 02:59 pm:   

Hi Nikos,

Just wondering ... in your case, would it be better to have an option to never create these .ERR files?

We do this primarily for cases where an SMSC connection has a temporary problem. It gives you an easy way to resubmit the messages.

We're having some more discussions about this internally before we make any changes. We are thinking that rather than keeping these files in the Q directory (or a subdirectory thereof), we should move them to a new directory structure so that they do not cause performance problems for the outbound message queue.

--
Des
NowSMS Support
Nikos Mavrakis
New member
Username: Nmavra

Post Number: 18
Registered: 05-2007
Posted on Monday, July 20, 2009 - 08:44 am:   

In our case not keeping ERR files would be even better since we have no use for them anyway. So if there was an option to create them or not, and if yes to manually choose how many days to keep them (like we have now with 1d) that would be great.

Do you think this is something easy to implement and include in a future patch?
Des - NowSMS Support
Board Administrator
Username: Desosms

Post Number: 1056
Registered: 08-2008
Posted on Tuesday, July 21, 2009 - 06:31 pm:   

Hi Nikos,

We're leaning toward extending the configuration option to allow ErrorQRetainDays=0, which would suppress the creation of these files.

It will likely be several weeks however.

--
Des
NowSMS Support
Nikos Mavrakis
New member
Username: Nmavra

Post Number: 19
Registered: 05-2007
Posted on Wednesday, July 22, 2009 - 09:34 am:   

Thats ok, in the mean time is there a way to re-enable the automatic folder creation somehow?
Bryce Norwood - NowSMS Support
Board Administrator
Username: Bryce

Post Number: 7834
Registered: 10-2002
Posted on Wednesday, July 22, 2009 - 03:40 pm:   

Hi Nikos,

No, unfortunately there is not a work-around.

The directories are only used if there are more than 10,000 messages that are currently in the queue. The logic forgets that these .ERR files might also be present.

It's possible to lower the 10,000 number (SMSGW.INI [SMSGW] MaxQDirEntries=#####), but I wouldn't recommend lowering it too much, because then you may end up with too many subdirectories, and that would have a performance effect.

-bn
Nikos Mavrakis
New member
Username: Nmavra

Post Number: 20
Registered: 05-2007
Posted on Wednesday, July 22, 2009 - 03:47 pm:   

Bryce our configuration does not seem to create these folders at all any more!

We get around 25,000 error files each day which I manually delete on workdays to make sure our windows 2003 system does not get crippled.

I have set it to delete them automatically after 1 day, but I cant seem to find the option to create the ERR subdirectories in the first place, I've lost it since we upgraded from 2009RC to 2009.
Bryce Norwood - NowSMS Support
Board Administrator
Username: Bryce

Post Number: 7835
Registered: 10-2002
Posted on Wednesday, July 22, 2009 - 04:17 pm:   

The subdirectories were not created for the .ERR files, they were created for the queued messages (.req files). When a submission fails, the .req file just gets renamed.

It works differently now because extra subdirs for the .req files are only created if the outbound message queue exceeds the threshold.

We need to consider creating dirs for the .ERR files, but technically they were not why the directories were created before.

-bn
Des - NowSMS Support
Board Administrator
Username: Desosms

Post Number: 1063
Registered: 08-2008
Posted on Thursday, July 23, 2009 - 03:14 pm:   

Hi Nikos,

Since this change is causing you operational issues, we made a small change to implement ErrorQRetainDays=0. When that setting is present, no ".ERR" files will be created at all.

This is one of 3 minor changes in the version of NowSMS posted to http://www.nowsms.com/download/nowsmsupdate.zip.

--
Des
NowSMS Support