Hello All Programmers !

Now using 1.0.7 with file pass-thru areas and just noticed a problem.

File area PASCLNET is pass-thru and this is showing log for processing:

-!-
10-Apr-2017 00:00:10 mbfido[8735] MBFIDO v1.0.7
10-Apr-2017 00:00:10 mbfido[8735] Cmd: mbfido tic toss web -quiet
+ 10-Apr-2017 00:00:10 mbfido[8735] Pass: hatch files
+ 10-Apr-2017 00:00:10 mbfido[8735] Pass: process ticfiles (/home/mbse/var/inbound)
+ 10-Apr-2017 00:00:10 mbfido[8735] Processing bb7e2e6f.tic, PASNDLST.Z99 area PASCLNET from 1:261/38
+ 10-Apr-2017 00:00:10 mbfido[8735] +- by BBBS/Li6 v4.10 Toy-3
+ 10-Apr-2017 00:00:10 mbfido[8735] 8.3 name "PASNDLST.Z99", LFN "pasndlst.z99"
+ 10-Apr-2017 00:00:10 mbfido[8735] Passthru TIC area!
+ 10-Apr-2017 00:00:10 mbfido[8735] Scanning /home/mbse/var/inbound/PASNDLST.Z99 with Clam AntiVirus stream scanner
+ 10-Apr-2017 00:00:10 mbfido[8735] Trying IPv4 127.0.0.1 port 3310
+ 10-Apr-2017 00:00:10 mbfido[8735] No banner command for
+ 10-Apr-2017 00:00:13 mbfido[8735] Execute: /usr/bin/rm -r -f arc8735
+ 10-Apr-2017 00:00:13 mbfido[8735] Forward file to 2:230/35@fidonet without netmail
+ 10-Apr-2017 00:00:14 mbfido[8735] Forward file to 2:250/9@fidonet without netmail
+ 10-Apr-2017 00:00:14 mbfido[8735] Processing bb7e2e8d.tic, PASNDLST.099 area PASCLNET from 1:261/38
+ 10-Apr-2017 00:00:14 mbfido[8735] +- by BBBS/Li6 v4.10 Toy-3
+ 10-Apr-2017 00:00:14 mbfido[8735] 8.3 name "PASNDLST.099", LFN "pasndlst.099"
+ 10-Apr-2017 00:00:14 mbfido[8735] Passthru TIC area!
? 10-Apr-2017 00:00:14 mbfido[8735] Duplicate file
+ 10-Apr-2017 00:00:14 mbfido[8735] Moving /home/mbse/var/inbound/bb7e2e8d.tic to /home/mbse/var/badtic/bb7e2e8d.tic
+ 10-Apr-2017 00:00:14 mbfido[8735] Moving /home/mbse/var/inbound/PASNDLST.099 to /home/mbse/var/badtic/PASNDLST.099
+ 10-Apr-2017 00:00:14 mbfido[8735] Pass: hatch files
+ 10-Apr-2017 00:00:14 mbfido[8735] Pass: process ticfiles (/home/mbse/var/inbound)
+ 10-Apr-2017 00:00:14 mbfido[8735] Pass: toss netmail (/home/mbse/var/inbound)
+ 10-Apr-2017 00:00:14 mbfido[8735] Pass: toss ARCmail (/home/mbse/var/inbound)
+ 10-Apr-2017 00:00:14 mbfido[8735] Start making statistic HTML pages
+ 10-Apr-2017 00:00:14 mbfido[8735] Finished making statistic HTML pages
+ 10-Apr-2017 00:00:14 mbfido[8735] Flushing outbound queue
+ 10-Apr-2017 00:00:14 mbfido[8735] Route to 2:250/9@fidonet via 2:250/9@fidonet
+ 10-Apr-2017 00:00:14 mbfido[8735] Adding files for 2:250/9@fidonet via 2:250/9@fidonet
? 10-Apr-2017 00:00:14 mbfido[8735] attach: file /home/mbse/var/inbound/PASNDLST.Z99 failed, No such file or directory
+ 10-Apr-2017 00:00:14 mbfido[8735] Route to 2:230/35@fidonet via 2:230/35@fidonet
+ 10-Apr-2017 00:00:14 mbfido[8735] Adding files for 2:230/35@fidonet via 2:230/35@fidonet
? 10-Apr-2017 00:00:14 mbfido[8735] attach: file /home/mbse/var/inbound/PASNDLST.Z99 failed, No such file or directory
+ 10-Apr-2017 00:00:14 mbfido[8735] TICfiles [ 2] import [ 0] out [ 2] bad [ 1] dupe [ 1]
-!-

If you look near the botton you will see that after tossing mbfido is trying to
attached file to two downlinks but cannot find the file (PASNDLST.Z99) in the ~/var/inbound directory.

Looks like it deleted it before finishing the tossing & attaching processing steps.

The above situation is the same for other instances with the same file area and
files.

Does it make sense ?


Vince

--- Mageia Linux v5/Mbse v1.0.6.15/GoldED+/LNX 1.1.501-b20150715
* Origin: Air Applewood, The Linux Gateway to the UK & Eire (2:250/1)

Hello Vince!

12 Apr 17 12:35, you wrote to all:

Now using 1.0.7 with file pass-thru areas and just noticed a problem.

File area PASCLNET is pass-thru and this is showing log for
processing:

-!-
10-Apr-2017 00:00:10 mbfido[8735] MBFIDO v1.0.7
10-Apr-2017 00:00:10 mbfido[8735] Cmd: mbfido tic toss web -quiet
+ 10-Apr-2017 00:00:10 mbfido[8735] Pass: hatch files
+ 10-Apr-2017 00:00:10 mbfido[8735] Pass: process ticfiles (/home/mbse/var/inbound)
+ 10-Apr-2017 00:00:10 mbfido[8735] Processing bb7e2e6f.tic,
PASNDLST.Z99 area PASCLNET from 1:261/38 + 10-Apr-2017 00:00:10 mbfido[8735] +- by BBBS/Li6 v4.10 Toy-3 + 10-Apr-2017 00:00:10 mbfido[8735] 8.3 name "PASNDLST.Z99", LFN "pasndlst.z99" + 10-Apr-2017 00:00:10 mbfido[8735] Passthru TIC area! + 10-Apr-2017 00:00:10 mbfido[8735] Scanning /home/mbse/var/inbound/PASNDLST.Z99 with Clam AntiVirus stream scanner + 10-Apr-2017 00:00:10 mbfido[8735] Trying
IPv4 127.0.0.1 port 3310 + 10-Apr-2017 00:00:10 mbfido[8735] No banner command for + 10-Apr-2017 00:00:13 mbfido[8735] Execute: /usr/bin/rm
-r -f arc8735 + 10-Apr-2017 00:00:13 mbfido[8735] Forward file to 2:230/35@fidonet without netmail + 10-Apr-2017 00:00:14 mbfido[8735] Forward file to 2:250/9@fidonet without netmail + 10-Apr-2017 00:00:14 mbfido[8735] Processing bb7e2e8d.tic, PASNDLST.099 area PASCLNET from 1:261/38 + 10-Apr-2017 00:00:14 mbfido[8735] +- by BBBS/Li6 v4.10
Toy-3 + 10-Apr-2017 00:00:14 mbfido[8735] 8.3 name "PASNDLST.099", LFN
"pasndlst.099" + 10-Apr-2017 00:00:14 mbfido[8735] Passthru TIC area!
? 10-Apr-2017 00:00:14 mbfido[8735] Duplicate file
+ 10-Apr-2017 00:00:14 mbfido[8735] Moving /home/mbse/var/inbound/bb7e2e8d.tic to
/home/mbse/var/badtic/bb7e2e8d.tic + 10-Apr-2017 00:00:14 mbfido[8735] Moving /home/mbse/var/inbound/PASNDLST.099 to /home/mbse/var/badtic/PASNDLST.099 + 10-Apr-2017 00:00:14 mbfido[8735] Pass: hatch files + 10-Apr-2017 00:00:14 mbfido[8735] Pass: process ticfiles (/home/mbse/var/inbound) + 10-Apr-2017 00:00:14 mbfido[8735] Pass: toss netmail (/home/mbse/var/inbound) + 10-Apr-2017 00:00:14 mbfido[8735] Pass: toss ARCmail (/home/mbse/var/inbound) + 10-Apr-2017 00:00:14 mbfido[8735] Start making statistic HTML pages + 10-Apr-2017 00:00:14 mbfido[8735] Finished making statistic HTML pages +
10-Apr-2017 00:00:14 mbfido[8735] Flushing outbound queue +
10-Apr-2017 00:00:14 mbfido[8735] Route to 2:250/9@fidonet via 2:250/9@fidonet
+ 10-Apr-2017 00:00:14 mbfido[8735] Adding files for 2:250/9@fidonet
via
2:250/9@fidonet
? 10-Apr-2017 00:00:14 mbfido[8735] attach: file /home/mbse/var/inbound/PASNDLST.Z99 failed, No such file or directory
+ 10-Apr-2017 00:00:14 mbfido[8735] Route to 2:230/35@fidonet via 2:230/35@fidonet
+ 10-Apr-2017 00:00:14 mbfido[8735] Adding files for 2:230/35@fidonet
via
2:230/35@fidonet
? 10-Apr-2017 00:00:14 mbfido[8735] attach: file /home/mbse/var/inbound/PASNDLST.Z99 failed, No such file or directory
+ 10-Apr-2017 00:00:14 mbfido[8735] TICfiles [ 2] import [ 0] out
[ 2] bad [ 1] dupe [ 1] -!-

If you look near the botton you will see that after tossing mbfido is trying to attached file to two downlinks but cannot find the file (PASNDLST.Z99) in the ~/var/inbound directory.

Looks like it deleted it before finishing the tossing & attaching processing steps.

The above situation is the same for other instances with the same file area and files.

Does it make sense ?

There does appear to be a problem. Apparently if a file is seen as a duplicate, it is immediately moved to the badtic directory. It shouldn't be trying to forward it to downlinks if it's a duplicate file. I'll have to dig further into the .TIC file code and get that sorted out.

Andrew

--- GoldED+/LNX 1.1.5-b20170303
* Origin: Phoenix BBS * phoenix.bnbbbs.net (1:320/219)

On 2017 Apr 13 19:32:54, you wrote to Vince Coen:

There does appear to be a problem. Apparently if a file is seen as a duplicate, it is immediately moved to the badtic directory. It
shouldn't be trying to forward it to downlinks if it's a duplicate
file. I'll have to dig further into the .TIC file code and get that sorted out.

shouldn't it be up to each system to determine what is a duplicate file and what is not? why should the contents of my files areas influence what files you
have? that's what you appear to be saying should be done... so if i create a file named mbse42.zip and a new official version 4.2 is hatched with the same name, those downstream from me won't get it even though they never had it and it only existed on my system until the new release was hatched... plus i might be greatly upset if my mbse42.zip were overwritten causing the loss of the information stored in it...

)\/(ark

Always Mount a Scratch Monkey
Do you manage your own servers? If you are not running an IDS/IPS yer doin' it wrong...
... We have nothing to be proud of but everything to be thankful for.
---
* Origin: (1:3634/12.73)

Hello mark!

Friday April 14 2017 06:32, you wrote to Andrew Leary:

On 2017 Apr 13 19:32:54, you wrote to Vince Coen:

There does appear to be a problem. Apparently if a file is seen
as a duplicate, it is immediately moved to the badtic directory.
It shouldn't be trying to forward it to downlinks if it's a
duplicate file. I'll have to dig further into the .TIC file code
and get that sorted out.

shouldn't it be up to each system to determine what is a duplicate
file and what is not? why should the contents of my files areas
influence what files you have? that's what you appear to be saying
should be done... so if i create a file named mbse42.zip and a new
official version 4.2 is hatched with the same name, those downstream
from me won't get it even though they never had it and it only existed
on my system until the new release was hatched... plus i might be
greatly upset if my mbse42.zip were overwritten causing the loss of
the information stored in it...

In the example I gave mbse often says the pasdnlst.nnn or .znn are dups when the .ext's are different. I would suggest that it may well only be comparing the filename without the .ext taken into consideration.

Only happens with this file areas as these are daily nodelists.

Blasted things are a pest.


Vince

--- Mageia Linux v5/Mbse v1.0.6.15/GoldED+/LNX 1.1.501-b20150715
* Origin: Air Applewood, The Linux Gateway to the UK & Eire (2:250/1)

Hello Vince!

14 Apr 17 12:30, you wrote to mark lewis:

In the example I gave mbse often says the pasdnlst.nnn or .znn are
dups when the .ext's are different. I would suggest that it may well
only be comparing the filename without the .ext taken into
consideration.

That's possible. I need to look further into that as well.

Only happens with this file areas as these are daily nodelists.

Blasted things are a pest.

The worst part is that without those daily nodelists and robot postings, the networks in question would be essentially dead.

Andrew

--- GoldED+/LNX 1.1.5-b20170303
* Origin: Phoenix BBS * phoenix.bnbbbs.net (1:320/219)

On 2017 Apr 14 12:30:04, you wrote to me:

Only happens with this file areas as these are daily nodelists.

do you also carry the DAILYLIST area?

i would think that you would see the same problem weekly in NODELIST and NODEDIFF as well... those would be less noticible as they would dupe out weekly...

then there's the thing that retaining nodelists for ages (historic archives) would detect dupes every 100 days, at least... so three times a year for most nodelist/nodediff names and four times a year for 000-065... throw in 066 every
four years, too...

Blasted things are a pest.

i have problems with certain areas carrying message echo lists... seems that they are updated several times a day and sometimes i get a new update before the previous one has been processed... in my mybrid setup, the new archive overwrites the older one but the TICs are processed in order... i have to manually intervene and remove the TICs for previous editions as well as copying
the remaining TIC and the file back to the inbound directory so it can be processed again...

this is with allfix, though... i've not yet set up a mbse system... i've been thinking about migrating my remote access setup from the DOS side of OS/2 to mbse... the problem is that i also want to DOSEMU my existing multinode door games... especially the multinode scrabble which allows for live play if all players are online at the same time...

)\/(ark

Always Mount a Scratch Monkey
Do you manage your own servers? If you are not running an IDS/IPS yer doin' it wrong...
... Cats like "Pro-Cat-Stinating"---it's the "Cats-Meow!"--jkb
---
* Origin: (1:3634/12.73)

Hello mark!

Friday April 14 2017 20:51, you wrote to me:

Only happens with this file areas as these are daily nodelists.

do you also carry the DAILYLIST area?

No I only get the dailies on this one because of downlinks requesting
it. Personally I have no use for dailies on Fidonet - have enough problems sometimes with issues relating to CRCs on nodediffs - weel at least for Sportsnet.
Did have it (the Dailies) on pass-thru but that is not working as it has lost the file from the inbound area before it can place it on hold (see an earlier message regarding this bug).




Vince

--- Mageia Linux v5/Mbse v1.0.6.15/GoldED+/LNX 1.1.501-b20150715
* Origin: Air Applewood, The Linux Gateway to the UK & Eire (2:250/1)