• Increasing display digits

    From Allen Prunty@1:2320/102 to All on Mon Jun 19 01:47:59 2017
    I have multiple message abses that are now in the 10,000's of messages and it only displays numbers like xxxx instead of xxxxx

    Is there any way I can add one more thousandth?

    ▒ Message Index Listing
    ─────────────────────────────────
    ## Subject
    ─────────────────────────────────
    1066 The lesser of two evils?
    1067 Re: The lesser of two evils?
    1067 The lesser of two evils?
    1067 The lesser of two evils?
    1067 The lesser of two evils?
    1067 The lesser of two evils?

    so it would look like...

    ▒ Message Index Listing
    ─────────────────────────────────
    ## Subject
    ─────────────────────────────────
    10669 The lesser of two evils?
    10670 Re: The lesser of two evils?
    10671 The lesser of two evils?
    10672 The lesser of two evils?
    10673 The lesser of two evils?
    10674 The lesser of two evils?

    I've looked in the default.txt and am having a great difficulty in this while my eyesight has vastly improved I'm struggling. I would appreciate any help
    on this.

    Allen

    --- Mystic BBS v1.12 A33 (Windows/32)
    * Origin: Mystical LiveWire - Rose Terrace, KY (1:2320/102)
  • From Dan Richter@1:317/3 to Allen Prunty on Mon Jun 19 01:27:44 2017
    On 06/19/17, Allen Prunty said the following...

    I have multiple message abses that are now in the 10,000's of messages
    and it only displays numbers like xxxx instead of xxxxx

    Yes there is a way to do it. Paul has done a video on this, so there are visuals as well. Take a look at: https://www.youtube.com/watch?v=hyVxo0u04MQ&t=735s

    I have also edited the ANSI screen to accommodate the extra space in the
    field as well. If you'd like, I can send it to you.

    If you have any questions on the changes needed, let me know. I can send you
    a netmail with what I have set up here.


    ---

    Dan Richter
    aka Black Panther
    Sysop - Castle Rock BBS (RCS)
    telnet://castlerockbbs.com
    The sparrows are flying again...

    --- Mystic BBS v1.12 A33 (Windows/64)
    * Origin: Castle Rock BBS - castlerockbbs.com (1:317/3)
  • From Paul Hayton@3:770/100 to Allen Prunty on Mon Jun 19 19:36:51 2017
    On 06/19/17, Allen Prunty pondered and said...

    I have multiple message abses that are now in the 10,000's of messages
    and it only displays numbers like xxxx instead of xxxxx

    Is there any way I can add one more thousandth?

    Yes, I made a video about this months ago. You can find it at https://youtu.be/hyVxo0u04MQ

    Best, Paul

    --- Mystic BBS v1.12 A33 (Windows/32)
    * Origin: Agency BBS | telnet://agency.bbs.geek.nz (3:770/100)
  • From g00r00@1:129/215 to Allen Prunty on Mon Jun 19 05:45:22 2017
    I have multiple message abses that are now in the 10,000's of messages
    and it only displays numbers like xxxx instead of xxxxx

    Is there any way I can add one more thousandth?

    This is a small change to a prompts 400 and 401 I think. It does not require any change to Mystic code, its just a poorly configured default that I should probably fix in the default installation.

    If you change the |$L04 to |$L05 on those prompts you should be good to go:

    400 |12|&5|08|23|$L05|&1|16
    401 |12|&5|07|$L05|&1

    --- Mystic BBS v1.12 A34 (Windows/32)
    * Origin: Sector 7 [Mystic BBS WHQ] (1:129/215)
  • From Allen Prunty@1:2320/100 to g00r00 on Mon Jun 19 23:33:22 2017
    Re: Increasing display digits
    By: g00r00 to Allen Prunty on Mon Jun 19 2017 05:45 am

    This is a small change to a prompts 400 and 401 I think. It does not require any change to Mystic code, its just a poorly configured default that I should probably fix in the default installation.

    If you change the |$L04 to |$L05 on those prompts you should be good to go:

    400 |12|&5|08|23|$L05|&1|16
    401 |12|&5|07|$L05|&1

    Thanks Jeff... not poorly configured... just some people have bigger archives than others. Also can you please increase the memory on the index reader... when I had all my usenet going into Mystic it was crashing things the code was out of memory.

    Anyhow let me get to that point again. Once again, glad you are back... While I do appreciate Pauls videos with my brain injury they don't compute as well as just what you posted above ... all I really needed was prompt 400 and 401 BOOM Fixed

    Allen

    ... TagLine support contract for renewal. Ignore this if you've already paid. --- SBBSecho 3.00-Win32
    * Origin: LiveWire BBS - Synchronet - LiveWireBBS.com (1:2320/100)
  • From Jeff Smith@1:282/1031 to Allen Prunty on Mon Jun 19 23:16:50 2017
    Hello Allen,


    Thanks Jeff... not poorly configured...

    Ummm... OK. Your welcome. <g>


    Jeff

    --- BBBS/Li6 v4.10 Toy-3
    * Origin: The OuijaBoard - Anoka, MN (1:282/1031)
  • From Dan Richter@1:317/3 to Allen Prunty on Tue Jun 20 02:08:43 2017
    On 06/19/17, Allen Prunty said the following...

    Thanks Jeff... not poorly configured... just some people have bigger archives than others. Also can you please increase the memory on the index reader... when I had all my usenet going into Mystic it was
    crashing things the code was out of memory.

    Allen,

    Just out of curiosity, about how many messages did you have when you were running Mystic before? The reason I'm asking, is right now, with the usenet messages, I'm at just over 1.2 million messages online. I can run the Indexed Message Reader on here. It takes about a minute or so for it to load everything, but it's still usable.


    ---

    Dan Richter
    aka Black Panther
    Sysop - Castle Rock BBS (RCS)
    telnet://castlerockbbs.com
    The sparrows are flying again...

    --- Mystic BBS v1.12 A33 (Windows/64)
    * Origin: Castle Rock BBS - castlerockbbs.com (1:317/3)
  • From Dan Richter@1:317/3 to Allen Prunty on Tue Jun 20 02:09:33 2017
    On 06/19/17, Allen Prunty said the following...

    Thanks Jeff... not poorly configured... just some people have bigger

    BTW, it's James... ;)


    ---

    Dan Richter
    aka Black Panther
    Sysop - Castle Rock BBS (RCS)
    telnet://castlerockbbs.com
    The sparrows are flying again...

    --- Mystic BBS v1.12 A33 (Windows/64)
    * Origin: Castle Rock BBS - castlerockbbs.com (1:317/3)
  • From g00r00@1:129/215 to Dan Richter on Tue Jun 20 21:01:41 2017
    usenet messages, I'm at just over 1.2 million messages online. I can run the Indexed Message Reader on here. It takes about a minute or so for it to load everything, but it's still usable.

    I've managed to reduce the time it takes to start up the reader when using giant message bases by quite a bit in the next alpha. The hold up is when it is calculating the statistics when you have a ton of unread messages.

    On my test system it takes less than half of the time in A34 as it did in A33.

    As you mention, the index reader should work fine with millions of messages. The only limitation is that it can only support 10,000 message bases, but that is something I can easily extend if anyone were to get close to that number.

    --- Mystic BBS v1.12 A34 (Windows/32)
    * Origin: Sector 7 [Mystic BBS WHQ] (1:129/215)
  • From Dan Richter@1:317/3 to g00r00 on Tue Jun 20 22:18:37 2017
    On 06/20/17, g00r00 said the following...

    usenet messages, I'm at just over 1.2 million messages online. I can the Indexed Message Reader on here. It takes about a minute or so for to load everything, but it's still usable.

    I've managed to reduce the time it takes to start up the reader when
    using giant message bases by quite a bit in the next alpha. The hold up is when it is calculating the statistics when you have a ton of unread messages.

    You're awesome!!

    On my test system it takes less than half of the time in A34 as it did
    in A33.

    I'm looking forward to A34! :)

    As you mention, the index reader should work fine with millions of messages. The only limitation is that it can only support 10,000 message bases, but that is something I can easily extend if anyone were to get close to that number.

    I know I'm not even close to that. Right now, I'm around 2400 message bases. I'm in the process of trimming some of the dead echos, and networks from the system as well.

    Thanks,


    ---

    Dan Richter
    aka Black Panther
    Sysop - Castle Rock BBS (RCS)
    telnet://castlerockbbs.com
    The sparrows are flying again...

    --- Mystic BBS v1.12 A33 (Windows/64)
    * Origin: Castle Rock BBS - castlerockbbs.com (1:317/3)
  • From Allen Prunty@1:2320/102 to Dan Richter on Fri Jun 23 04:15:34 2017
    Just out of curiosity, about how many messages did you have when you were running Mystic before? The reason I'm asking, is right now, with the usenet messages, I'm at just over 1.2 million messages online. I can run the Indexed Message Reader on here. It takes about a minute or so for it to load everything, but it's still usable.


    2.8 Billion... I had three newsgroups with over a million messages in each base. One was rec.arts.food.cooking or maybe rec.food cooking it was a
    cooking group :-)

    I also have massive retention on fidonet... most of my echos go back 5 years
    in retention.

    Allen

    --- Mystic BBS v1.12 A33 (Windows/32)
    * Origin: Mystical LiveWire - Rose Terrace, KY (1:2320/102)
  • From Allen Prunty@1:2320/102 to Dan Richter on Fri Jun 23 04:23:46 2017
    Stan (evil grin),

    James knows I've had a Traumatic Brain Injury and sometimes the synapses
    don't quite fire right. I have a big problem with names that sound similar. Jeff becomes James... Dan Becomes Stan... and on really bad days Doug. The only one I can think of I haven't messed up is Paul and that's because one of my best friends is a Paul that I see every day.

    I'm not too bad with getting things done, but what simplifies things for some (videos for instance) confuses me greater. I get words mixed up terribly...
    as I was calling watermelon "Pumpkin" during the Church picnic this weekend.

    And sometimes I will mix up a cuss word with a normal word... or use
    something normal as a cuss word. Trust me it's quite entertaining. Or when
    I get overwhelmed like when I met Bono last weekend... anything is possible, but it was one of the highlights of my life. Ranks up there when I met Pat Benetar and Cyndi Lauper.

    Allen

    --- Mystic BBS v1.12 A33 (Windows/32)
    * Origin: Mystical LiveWire - Rose Terrace, KY (1:2320/102)
  • From Allen Prunty@1:2320/102 to g00r00 on Fri Jun 23 04:42:06 2017
    On my test system it takes less than half of the time in A34 as it did
    in A33.

    I had a traditional spinning Hard drive at the time that I was crashing...
    and boy did it ever thrash that drive hard when I used index. I have scaled down my operations quite a bit since then. I carried a lot of the Usenet backbone at the time. I now have a solid state and I can say that the speed has drastically improved so A34 may seem almost instantaneous now.

    As you mention, the index reader should work fine with millions of messages. The only limitation is that it can only support 10,000 message bases, but that is something I can easily extend if anyone were to get close to that number.

    Paul even logged in and confirmed it crashed at my peak... I did reduce my retention and don't think I have any group with more than 50,000 messages.
    One thing that I may suggest that would help things tremendously is to
    perhaps consider not scanning message bases for personal messages that are flagged as newsgroup... just then look at the unread totals without scanning
    to see if there is personal mail.

    Right now I haven't rescanned the newsgroups back into Mystic and it's really behaving well with my larger fido retention.

    But when I had everything on mystic I would hit the I go off and put on a kettle of water for tea wait for it to boil and come back to it still
    counting things up. And eventually it started to crash... and in retrospect that hard drive failed so it's entirely possible that could have been the culprit too.

    The crash code traced to out of memory error though. You are doing great fixing things... hats off to you and welcome back.

    Allen

    --- Mystic BBS v1.12 A33 (Windows/32)
    * Origin: Mystical LiveWire - Rose Terrace, KY (1:2320/102)
  • From Allen Prunty@1:2320/102 to Dan Richter on Fri Jun 23 04:44:01 2017
    I know I'm not even close to that. Right now, I'm around 2400 message bases. I'm in the process of trimming some of the dead echos, and
    networks from the system as well.

    We had a little bit of a slowdown on usenet as when U of L let out for summer the old Vax that I get the newsgroups from was powered down and no one there knew how to bring it back up. It is online now and things are once again flowing.

    Allen

    --- Mystic BBS v1.12 A33 (Windows/32)
    * Origin: Mystical LiveWire - Rose Terrace, KY (1:2320/102)
  • From g00r00@1:129/215 to Allen Prunty on Sun Jun 25 10:30:08 2017
    I had a traditional spinning Hard drive at the time that I was
    crashing... and boy did it ever thrash that drive hard when I used

    Did it crash with an error, or did it just seem to "lock up" and sit there doing nothing forever?

    I'll make some test cases on my end and get it sorted out. I don't think I've tested a million messages since I added in the index reader, so I don't doubt there is an issue there.

    But the rest should work fine, including the message list where you scroll through the messages. It was a challenge to pull that off back in the DOS days when I only had 640KB of memory but Mystic did it...

    Some current iterations of message readers will try to load all 1 million messages at once eating up all of the memory on the system, bringing it to a halt. Mystic uses like 12KB of memory lol

    messages. One thing that I may suggest that would help things
    tremendously is to perhaps consider not scanning message bases for personal messages that are flagged as newsgroup... just then look at the

    This is a good idea, thank you. I'll test up some tests and see what I can do to further improve speed or fix any problems.

    But when I had everything on mystic I would hit the I go off and put on a kettle of water for tea wait for it to boil and come back to it still counting things up. And eventually it started to crash... and in retrospect that hard drive failed so it's entirely possible that could have been the culprit too.

    Yes, there is no doubt it would take a while to load that many messages, especially with the old system! Maybe it was the hard drive too. I'll get
    to the bottom of it!

    --- Mystic BBS v1.12 A35 (Windows/32)
    * Origin: Sector 7 [Mystic BBS WHQ] (1:129/215)
  • From g00r00@1:129/215 to Allen Prunty on Sun Jun 25 19:04:49 2017
    On my test system it takes less than half of the time in A34 as it di in A33.

    I had a traditional spinning Hard drive at the time that I was
    crashing... and boy did it ever thrash that drive hard when I used

    I did some more looking into things with JAM and super huge data sets.

    Mystic works perfectly fine with millions of messages in a single base. All readers are instant and snappy in A35 and it doesn't use more memory to scroll around a list of 1,000,000 messages than it does to do so with 2 messages. The index reader calculation was so fast that at first I thought it wasn't working!

    Everything is great UNTIL... You hit the *JAM file size limitation*

    JAM can only grow to a certain size per message base before it cannot grow any bigger. I did put a check in to stop Mystic from crashing if the .JDT file gets too big, but that doesn't really solve the problem which is simply that you've reached the end of the road as far as what JAM can do.

    I've thought about making an optional "JAM64" format which would allow file sizes up to 18 terabytes. This revised JAM would be enough to store billions of messages in a single base, but the problem with that is that it wouldn't work with existing 3rd party JAM utilities.

    --- Mystic BBS v1.12 A35 (Windows/32)
    * Origin: Sector 7 [Mystic BBS WHQ] (1:129/215)
  • From Paul Hayton@3:770/100 to g00r00 on Mon Jun 26 13:25:48 2017
    On 06/25/17, g00r00 pondered and said...

    JAM can only grow to a certain size per message base before it cannot
    grow any bigger. I did put a check in to stop Mystic from crashing if
    the .JDT file gets too big, but that doesn't really solve the problem which is simply that you've reached the end of the road as far as what
    JAM can do.

    I've thought about making an optional "JAM64" format which would allow file sizes up to 18 terabytes. This revised JAM would be enough to
    store billions of messages in a single base, but the problem with that
    is that it wouldn't work with existing 3rd party JAM utilities.

    I think creating this new format is a good move and just allow users to
    decide when they set up their bases which format they want to select. You
    could make it a default message base setting but allow that to be changed on
    a per message base basis.

    If you do this, I expect some proactive souls here and elsewhere will work on supporting the new format and creating utils for it. 18TB heck yes :)

    --- Mystic BBS v1.12 A33 (Windows/32)
    * Origin: Agency BBS | telnet://agency.bbs.geek.nz (3:770/100)
  • From g00r00@1:129/215 to Paul Hayton on Sun Jun 25 23:07:08 2017
    I think creating this new format is a good move and just allow users to decide when they set up their bases which format they want to select. You could make it a default message base setting but allow that to be
    changed on a per message base basis.

    I think it'd be rare that people really have millions of messages, but Mystic handles it so well that I hate it being limited by JAM. There are a few other limitations I can fix too like dates not working past 2038 (just in case any of us are still kicking then lol)

    I've been brainstorming a bit and working on the changes needed so we'll see how that goes. I'll document it as well just in case anyone else cares to support it.

    --- Mystic BBS v1.12 A35 (Windows/32)
    * Origin: Sector 7 [Mystic BBS WHQ] (1:129/215)
  • From Dan Richter@1:317/3 to g00r00 on Sun Jun 25 21:07:14 2017
    On 06/25/17, g00r00 said the following...

    Everything is great UNTIL... You hit the *JAM file size limitation*

    JAM can only grow to a certain size per message base before it cannot
    grow any bigger. I did put a check in to stop Mystic from crashing if

    What is the current limitation of the JAM message base?

    I've thought about making an optional "JAM64" format which would allow file sizes up to 18 terabytes. This revised JAM would be enough to
    store billions of messages in a single base, but the problem with that
    is that it wouldn't work with existing 3rd party JAM utilities.

    I personally don't think it would be worth it at this point. How many systems are going to need that size of a message base available? As far as I know, there are only a couple of systems that have a high retention period for messages. While it would be nice to have those capabilities, I don't see a practical use for it. But that is just my opinion. :)


    ---

    Dan Richter
    aka Black Panther
    Sysop - Castle Rock BBS (RCS)
    telnet://castlerockbbs.com
    The sparrows are flying again...

    --- Mystic BBS v1.12 A34 (Windows/64)
    * Origin: Castle Rock BBS - castlerockbbs.com (1:317/3)
  • From g00r00@1:129/215 to Dan Richter on Mon Jun 26 10:24:01 2017
    JAM can only grow to a certain size per message base before it cannot grow any bigger. I did put a check in to stop Mystic from crashing i

    What is the current limitation of the JAM message base?

    None of the file sizes can grow past 4.2 gigs in size or it will blow up. Dates will not work after 2038, CRC32 isn't a good way to hash for searching with an increased message base size (CRC64 is still lightweight and would work better)

    Those are the biggest problems with JAM. My revision would solve them all.

    To give some perspective 1 million messages with 250 lines in each was around 20 gigs, or 4 times too big for JAM. So in that case you are looking at a cap of maybe ~250,000 messages, drastically more or less depending on message content.

    I personally don't think it would be worth it at this point. How many systems are going to need that size of a message base available? As far

    I can't say but I do know that at least one person has hit the limit thus far.

    --- Mystic BBS v1.12 A35 (Windows/32)
    * Origin: Sector 7 [Mystic BBS WHQ] (1:129/215)
  • From Dan Richter@1:317/3 to g00r00 on Mon Jun 26 16:12:45 2017
    On 06/26/17, g00r00 said the following...

    What is the current limitation of the JAM message base?

    None of the file sizes can grow past 4.2 gigs in size or it will blow

    Ok, I was just wondering if my bases were getting close. My largest JAM base
    is only 140 meg right now, so I'm good for awhile. :)

    up. Dates will not work after 2038, CRC32 isn't a good way to hash for

    I wasn't aware of the date issue. I'm hoping that I'm still running a BBS at that point. I should be retired by then and able to run it full time. :)

    To give some perspective 1 million messages with 250 lines in each was around 20 gigs, or 4 times too big for JAM. So in that case you are looking at a cap of maybe ~250,000 messages, drastically more or less depending on message content.

    Thank you. That does put it into perspective for me. I knew there was a limit to JAM, but couldn't remember what it was... The joys of getting old... :)

    I personally don't think it would be worth it at this point. How many systems are going to need that size of a message base available? As f

    I can't say but I do know that at least one person has hit the limit
    thus far.

    I know that Allen has had issues in the past with it. For me, I've got all my bases capped at 10,000 messages per base. Even at that point, the messages
    can get so old, they aren't really good for reference anymore.

    Thanks again for the info.


    ---

    Dan Richter
    aka Black Panther
    Sysop - Castle Rock BBS (RCS)
    telnet://castlerockbbs.com
    The sparrows are flying again...

    --- Mystic BBS v1.12 A34 (Windows/64)
    * Origin: Castle Rock BBS - castlerockbbs.com (1:317/3)
  • From Allen Prunty@1:2320/100 to g00r00 on Mon Jun 26 21:08:32 2017
    Re: Increasing display digits
    By: g00r00 to Allen Prunty on Sun Jun 25 2017 07:04 pm

    Mystic works perfectly fine with millions of messages in a single base. All readers are instant and snappy in A35 and it doesn't use more memory to scroll around a list of 1,000,000 messages than it does to do so with 2 messages. The index reader calculation was so fast that at first I thought it wasn't working!

    Don't tell Mark Lynch that... according to him Jam does not have size limitations. The biggest base I had going were the UFO bases, and the grandaddy food cooking newsgroup.

    Allen

    ... If at first you don't succeed, destroy all evidence that you tried.
    --- SBBSecho 3.00-Win32
    * Origin: LiveWire BBS - Synchronet - LiveWireBBS.com (1:2320/100)
  • From mark lewis@1:3634/12.73 to Dan Richter on Mon Jun 26 22:32:12 2017

    On 2017 Jun 26 16:12:44, you wrote to g00r00:

    To give some perspective 1 million messages with 250 lines in each
    was around 20 gigs, or 4 times too big for JAM. So in that case you
    are looking at a cap of maybe ~250,000 messages, drastically more or
    less depending on message content.

    Thank you. That does put it into perspective for me. I knew there was
    a limit to JAM, but couldn't remember what it was... The joys of
    getting old... :)

    there are additional limits, too... one being the highest message number which is the 2Meg limit... plus on some systems, the 4Gig limit of the message base size is only 2Gig due to OS limits... i remember when JAM was first introduced and folks complained greatly about it being ""so slow""... but then we found they had all of their bases in one directory... that was causing them to run into a slow down in the OS when it enumerated the files in a directory... it was found that limiting the number of JAM bases to a specific directory brought
    the speed back up again... IIRC, there was a problem with the OS and enumerating files when there were more than 1024 files in a directory... since JAM has four files per base, the easiest thing to do was for the operators to place no more than like 100 bases per directory... that's what we did during the BETA phase of JAM development and today we have the bases split into alpha directories so those beginning with 'a' are in the JAM/a/ directory and similar
    with others... plus we're grouping by network, as well...

    )\/(ark

    Always Mount a Scratch Monkey
    Do you manage your own servers? If you are not running an IDS/IPS yer doin' it wrong...
    ... Never get into fights with ugly people, they have nothing to lose.
    ---
    * Origin: (1:3634/12.73)
  • From mark lewis@1:3634/12.73 to Allen Prunty on Mon Jun 26 22:39:10 2017

    On 2017 Jun 26 21:08:32, you wrote to g00r00:

    Mystic works perfectly fine with millions of messages in a single
    base. All readers are instant and snappy in A35 and it doesn't use
    more memory to scroll around a list of 1,000,000 messages than it
    does to do so with 2 messages. The index reader calculation was so
    fast that at first I thought it wasn't working!

    Don't tell Mark Lynch that...

    who is that???

    according to him Jam does not have size limitations. The biggest base
    I had going were the UFO bases, and the grandaddy food cooking
    newsgroup.

    JAM certainly has limitations... physical file size is one and it /may/ be limited by the OS... then there's the number of messages per area as well as the maximum numbering of messages per area... the former being the quantity and
    the latter being the ID number in the base...

    )\/(ark

    Always Mount a Scratch Monkey
    Do you manage your own servers? If you are not running an IDS/IPS yer doin' it wrong...
    ... DOCTOR: "First the good news. Your name will go down in history...."
    ---
    * Origin: (1:3634/12.73)
  • From Dan Richter@1:317/3 to mark lewis on Mon Jun 26 22:10:31 2017
    On 06/26/17, mark lewis said the following...

    directory... that was causing them to run into a slow down in the OS
    when it enumerated the files in a directory... it was found that
    limiting the number of JAM bases to a specific directory brought the
    speed back up again... IIRC, there was a problem with the OS and enumerating files when there were more than 1024 files in a directory...

    I wonder if that might be part of the problem on my end. While I do have the files separated by network, I still have directories with 11,577 files, 1586 files and 1204 files. Perhaps it would be a good idea if I broke those down a bit...

    since JAM has four files per base, the easiest thing to do was for the

    I thought the JAM bases only had four files per base... Under Windoze 10
    64bit here, Mystic has seven files per base... For example:

    mystic.jdt
    mystic.jdx
    mystic.jhr
    mystic.jlr
    mystic
    mystic.scn
    mystic.xlr

    what we did during the BETA phase of JAM development and today we have
    the bases split into alpha directories so those beginning with 'a' are
    in the JAM/a/ directory and similar with others... plus we're grouping by

    That's not a bad idea. As I said, I've got them divided by network here. At least the larger networks, and usenet areas I think I should split up some more.

    Thanks


    ---

    Dan Richter
    aka Black Panther
    Sysop - Castle Rock BBS (RCS)
    telnet://castlerockbbs.com
    The sparrows are flying again...

    --- Mystic BBS v1.12 A34 (Windows/64)
    * Origin: Castle Rock BBS - castlerockbbs.com (1:317/3)
  • From Allen Prunty@1:2320/102 to Dan Richter on Tue Jun 27 02:50:54 2017
    I personally don't think it would be worth it at this point. How many systems are going to need that size of a message base available? As far
    as I know, there are only a couple of systems that have a high retention period for messages. While it would be nice to have those capabilities,
    I don't see a practical use for it. But that is just my opinion. :)


    I am one of them :-) I had ten years retention on my newsgroups at one time
    and thought that the JAM base was more than capable of handling them. Seemed like it was at the time.

    Allen

    --- Mystic BBS v1.12 A33 (Windows/32)
    * Origin: Mystical LiveWire - Rose Terrace, KY (1:2320/102)
  • From Allen Prunty@1:2320/102 to mark lewis on Tue Jun 27 02:56:07 2017
    On 06/26/17, mark lewis said the following...

    who is that???


    It's you... you were the one that once told me you did some testing on Jam
    base sized... I'm horrid with last names, be very glad I got your first one right :-) I hate to admit it but I had another fall this weekend... although
    I had a good trip this damn Brain Trauma thing is starting to get old.

    Allen

    BTW. The names I have for people offline are even worse... mostly for my own entertianment though but I have my own way of keeping track of who is who....
    I call you RA-Marc offline because that's how I mostly knew you back in the day.

    --- Mystic BBS v1.12 A33 (Windows/32)
    * Origin: Mystical LiveWire - Rose Terrace, KY (1:2320/102)
  • From mark lewis@1:3634/12.73 to Dan Richter on Tue Jun 27 09:12:40 2017

    On 2017 Jun 26 22:10:30, you wrote to me:

    directory... that was causing them to run into a slow down in the OS
    when it enumerated the files in a directory... it was found that
    limiting the number of JAM bases to a specific directory brought the
    speed back up again... IIRC, there was a problem with the OS and
    enumerating files when there were more than 1024 files in a
    directory...

    I wonder if that might be part of the problem on my end. While I do
    have the files separated by network, I still have directories with
    11,577 files, 1586 files and 1204 files. Perhaps it would be a good
    idea if I broke those down a bit...

    that was DOS 6.something, IIRC... i didn't see it so bad on my OS/2 system (which is still running RA/FD/FE) but i still split things up just in case...

    since JAM has four files per base, the easiest thing to do was for
    the

    I thought the JAM bases only had four files per base... Under Windoze
    10 64bit here, Mystic has seven files per base... For example:

    mystic.jdt
    mystic.jdx
    mystic.jhr
    mystic.jlr
    mystic
    mystic.scn
    mystic.xlr

    the jdt, jdx, jhr, and jlr files are the only ones related to JAM... the others
    are something for the BBS and its tosser, i guess...

    jdt is the data file containing the message bodies.
    jdx is the index file.
    jhr is the data file containing the message headers.
    jlr is the data file containing the lastread pointers for the BBS users.

    i'm going to guess that the scn file is for mystic's tosser to know what the last message was in the base when it last scanned out newly written mail... xlr
    would seem to maybe a some sort of lastread container and i've no clue on the other file...

    what we did during the BETA phase of JAM development and today we
    have the bases split into alpha directories so those beginning with
    'a' are in the JAM/a/ directory and similar with others... plus we're
    grouping by

    That's not a bad idea. As I said, I've got them divided by network
    here. At least the larger networks, and usenet areas I think I should split up some more.

    yeah, we have something like

    jam/
    jam/fido/
    jam/fido/a/ (fido echos starting with 'a')
    jam/fido/b/ (fido echos starting with 'b')
    jam/fido/c/cooking (COOKING)
    [...]
    jam/fido/f/fido/
    jam/fido/f/fido/sysop (FIDO_SYSOP)
    jam/fido/f/fido/test (FIDOTEST)
    [...]
    jam/usenet/alt/foo/foo (alt.foo.foo) jam/usenet/alt/swedish/chef/bork/bork/bork (alt.swedish.chef.bork.bork.bork) jam/usenet/comp/blah/erk (comp.blah.erk)
    [...]
    jam/fuznet/
    jam/fuznet/a/ (fuznet echos starting with 'a')
    jam/fuznet/b/ (fuznet echos starting with 'b')
    [...]

    some things we break down a little more than others but the main thing was alphabetical grouping...

    )\/(ark

    Always Mount a Scratch Monkey
    Do you manage your own servers? If you are not running an IDS/IPS yer doin' it wrong...
    ... Sure, when- OINK [flap] OINK [flap] Well, I'll be!
    ---
    * Origin: (1:3634/12.73)
  • From g00r00@1:129/215 to Allen Prunty on Tue Jun 27 10:33:20 2017
    Don't tell Mark Lynch that... according to him Jam does not have size limitations. The biggest base I had going were the UFO bases, and the grandaddy food cooking newsgroup.

    I have no idea who that is, but I can assure you they're mistaken. This isn't something that is "debatable" - its 100% certain. :)

    The JAM index file uses a byte position and its an unsigned 32-bit integer which has a max value of 4,294,967,295. The message header itself also has a byte position stored as an unsigned 32-bit integer which has the same problem.

    If the header or text data file in a JAM base grows larger than that number in bytes, then JAM cannot work anymore.

    Its the same thing with the dates they're stored as Unix time stamps in unsigned 32-bit integers, and they will fail in 2038. The same thing for raw message numbers too (although 4 billion messages is probably acceptable lol)

    --- Mystic BBS v1.12 A35 (Windows/32)
    * Origin: Sector 7 [Mystic BBS WHQ] (1:129/215)
  • From g00r00@1:129/215 to mark lewis on Tue Jun 27 12:18:39 2017
    mystic.jdt
    mystic.jdx
    mystic.jhr
    mystic.jlr
    mystic
    mystic.scn
    mystic.xlr

    the jdt, jdx, jhr, and jlr files are the only ones related to JAM... the others are something for the BBS and its tosser, i guess...

    Yes, Mystic uses .SCN .XLR and .LNK for various things per message base in addition to the base JAM files. These track things like the user's scan new scan and QWK settings per base, echomail export information, echomail systems who are subscribed to the message base, etc.

    --- Mystic BBS v1.12 A35 (Windows/32)
    * Origin: Sector 7 [Mystic BBS WHQ] (1:129/215)
  • From robert wolfe@1:116/18 to Allen Prunty on Thu Jul 13 19:38:00 2017
    On 06-85-39, Allen Prunty said...

    I personally don't think it would be worth it at this point. How many systems are going to need that size of a message base available? As f as I know, there are only a couple of systems that have a high retent period for messages. While it would be nice to have those capabilitie I don't see a practical use for it. But that is just my opinion. :)


    I am one of them :-) I had ten years retention on my newsgroups at one tim and thought that the JAM base was more than capable of handling them. See like it was at the time.

    Who do you have as your newgroup provider?

    --- Mystic BBS v1.05/OS2
    * Origin: Neptune's Lair/2 * Olive Branch MS * os2bbs.org (1:116/18)
  • From robert wolfe@1:116/18 to g00r00 on Thu Jul 13 19:39:00 2017
    On 06-85-39, g00r00 said...

    I have no idea who that is, but I can assure you they're mistaken. This is something that is "debatable" - its 100% certain. :)

    The JAM index file uses a byte position and its an unsigned 32-bit integer which has a max value of 4,294,967,295. The message header itself also ha byte position stored as an unsigned 32-bit integer which has the same prob


    Which is why I pack my JAM bases on a fairly regular basis :)

    --- Mystic BBS v1.05/OS2
    * Origin: Neptune's Lair/2 * Olive Branch MS * os2bbs.org (1:116/18)
  • From robert wolfe@1:116/18 to Allen Prunty on Thu Jul 13 19:38:00 2017
    On 06-85-39, Allen Prunty said...

    I personally don't think it would be worth it at this point. How many systems are going to need that size of a message base available? As f as I know, there are only a couple of systems that have a high retent period for messages. While it would be nice to have those capabilitie I don't see a practical use for it. But that is just my opinion. :)


    I am one of them :-) I had ten years retention on my newsgroups at one tim and thought that the JAM base was more than capable of handling them. See like it was at the time.

    Who do you have as your newgroup provider?

    --- Mystic BBS v1.05/OS2
    * Origin: Neptune's Lair/2 * Olive Branch MS * os2bbs.org (1:116/18)
  • From robert wolfe@1:116/18 to g00r00 on Thu Jul 13 19:39:00 2017
    On 06-85-39, g00r00 said...

    I have no idea who that is, but I can assure you they're mistaken. This is something that is "debatable" - its 100% certain. :)

    The JAM index file uses a byte position and its an unsigned 32-bit integer which has a max value of 4,294,967,295. The message header itself also ha byte position stored as an unsigned 32-bit integer which has the same prob


    Which is why I pack my JAM bases on a fairly regular basis :)

    --- Mystic BBS v1.05/OS2
    * Origin: Neptune's Lair/2 * Olive Branch MS * os2bbs.org (1:116/18)
  • From Allen Prunty@1:2320/100 to robert wolfe on Mon Jul 24 07:14:00 2017
    Re: Re: Increasing display digits
    By: robert wolfe to Allen Prunty on Thu Jul 13 2017 07:38 pm

    I am one of them :-) I had ten years retention on my newsgroups at
    one tim and thought that the JAM base was more than capable of
    handling them. See like it was at the time.

    Who do you have as your newgroup provider?

    It's a private server from the university... probably one of the few Dec PDP11 micros that are still in operation... and there's much more than 10 years there.

    Allen

    ... If man were immortal, do you realise what his meat bills would be?
    --- SBBSecho 3.00-Win32
    * Origin: LiveWire BBS - Synchronet - LiveWireBBS.com (1:2320/100)
  • From Robert Wolfe@1:116/18 to Allen Prunty on Mon Jul 24 19:57:00 2017
    Who do you have as your newgroup provider?

    It's a private server from the university... probably one of the few Dec PDP11
    micros that are still in operation... and there's much more than 10 years there.

    Cool, cool. :)

    --- EleBBS/OS2 v20120208.d
    * Origin: Neptune's Lair/2 * Olive Branch, MS USA * os2bbs.org (1:116/18)
  • From Robert Wolfe@1:116/17 to ALLEN PRUNTY on Mon Jul 24 20:46:16 2017

    Who do you have as your newgroup provider?

    It's a private server from the university... probably one of the few
    Dec PDP11 micros that are still in operation... and there's much more
    than 10 years there.

    Ah, ok, cool! :)
    --- Platinum Xpress/Win/WINServer v3.0pr5
    * Origin: Neptune's Lair - Olive Branch MS - winserver.org (1:116/17)
  • From mark lewis@1:3634/12.73 to Robert Wolfe on Fri Jul 28 08:46:20 2017

    On 2017 Jul 24 20:46:16, you wrote to ALLEN PRUNTY:

    --- Platinum Xpress/Win/WINServer v3.0pr5
    * Origin: Neptune's Lair - Olive Branch MS - winserver.org (1:116/17)

    as noted in another post in another area, this one is still winserver.org as seen in the origin line...

    )\/(ark

    Always Mount a Scratch Monkey
    Do you manage your own servers? If you are not running an IDS/IPS yer doin' it wrong...
    ... Real programmers begin "COPY CON PROG.EXE"
    ---
    * Origin: (1:3634/12.73)
  • From Allen Prunty@1:2320/100 to Robert Wolfe on Thu Aug 10 06:39:37 2017
    Re: Re: Increasing display digits
    By: Robert Wolfe to ALLEN PRUNTY on Mon Jul 24 2017 08:46 pm

    It's a private server from the university... probably one of the few
    Dec PDP11 micros that are still in operation... and there's much more
    than 10 years there.

    Ah, ok, cool! :)

    Yeah... and they have a pretty good amoutn of disk space on it. They have adapted a modern 5gb hard drive raid system to it. They are soon goin to shut down the whole vax cluster and run it on one of the newer multi-core macs on a virtual machine environment.

    I know that a lot of the educational and programming newsgroups go back to the early 1980's

    Allen

    ... If a circuit cannot fail, it will.
    --- SBBSecho 3.00-Win32
    * Origin: LiveWire BBS - Synchronet - LiveWireBBS.com (1:2320/100)
  • From Robert Wolfe@1:116/17 to ALLEN PRUNTY on Thu Aug 10 17:49:42 2017

    Re: Re: Increasing display digits
    By: Robert Wolfe to ALLEN PRUNTY on Mon Jul 24 2017 08:46 pm

    It's a private server from the university... probably one of the few ->> Dec PDP11 micros that are still in operation... and there's much more ->> than 10 years there.

    Ah, ok, cool! :)

    Yeah... and they have a pretty good amoutn of disk space on it. They have ->adapted a modern 5gb hard drive raid system to it. They are soon goin to shut
    down the whole vax cluster and run it on one of the newer multi-core macs on a
    virtual machine environment.

    I know that a lot of the educational and programming newsgroups go back to the
    early 1980's

    Well, if you need a news feed, I can give you one via FTN :) You just need to tell me what groups you want so I can request them from my uplink and put them in place :)




    ...If Clinton is the answer it must been a stupid question.
    ---BapStats Module (bsDBASE v6.1 Build 1)

    * Origin: Neptune's Lair - Olive Branch MS - winserver.org (1:116/17)
  • From Allen Prunty@1:2320/100 to Robert Wolfe on Thu Aug 10 22:19:56 2017
    Re: Re: Increasing display digits
    By: Robert Wolfe to ALLEN PRUNTY on Thu Aug 10 2017 05:49 pm

    Well, if you need a news feed, I can give you one via FTN :) You just need to tell me what groups you want so I can request them from my uplink and put them in place :)

    I have most of the usnet backbone no need for a feed yet. And I can provide a feed too.

    Allen

    ... Liberals are a Labour-saving device.
    --- SBBSecho 3.00-Win32
    * Origin: LiveWire BBS - Synchronet - LiveWireBBS.com (1:2320/100)