Latest Updates:
Page Index Toggle Pages: [1] 2 
Topic Tools
Hot Topic (More than 10 Replies) Chessbase Reader 2017 with non-chessbase DBs? (Read 986 times)
an ordinary chessplayer
God Member
*****
Offline


I used to be not bad.

Posts: 1175
Location: Columbus, OH (USA)
Joined: 01/02/15
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #21 - 05/03/21 at 03:50:45
Post Tools
Michael Ayton wrote on 05/02/21 at 21:15:35:
I don’t know if it helps comprehension of my earlier last sentence to say that in CB 8.0 the ChessX association is created if I select pgn, but if I select ‘text’, I do get a text file, in Notepad.

Yes, now I see. But usually we don't want a .txt file, we want a .pgn file. And the Text export in ChessBase lacks the correct .pgn headers for the games.

Michael Ayton wrote on 05/02/21 at 21:15:35:
Re your ‘Simplest’ solution’, that box was already checked. Re the other solution: the ‘Always open with the selected program’ device appears to work, ...

Great.

Michael Ayton wrote on 05/02/21 at 21:15:35:
... but when I try to export from SCID, even if I’ve selected only two or three games I get ‘File too big’ messages for both Notepad and MS Word, with the latter saying file is larger than 512 MB (2,358,526 KB)!

Actually, you might find a program to open a file larger than 512 MB, but you won't find any 32-bit program that can open a file as large as that one. 2 GB is the limit.

Scid gives me some trouble exporting selected or filtered games. What I do is drag them to the clipbase and export from there. It's the only way I can reliably export just the selected games instead of the whole database. ChessBase 8 doesn't give me any trouble, operations on the selected games is one thing ChessBase does really well. But I usually do use the clipbase after all, since I'm used to doing things that way.
  
Back to top
 
IP Logged
 
Michael Ayton
God Member
*****
Offline


‘You’re never alone with
a doppelgänger.’

Posts: 1892
Location: durham
Joined: 04/19/03
Gender: Male
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #20 - 05/02/21 at 21:15:35
Post Tools
@ an ordinary chessplayer

Thank for this, AOC, and sorry I didn’t say so earlier – a case of POW, nay, mega-POW …

I don’t know if it helps comprehension of my earlier last sentence to say that in CB 8.0 the ChessX association is created if I select pgn, but if I select ‘text’, I do get a text file, in Notepad.

Re your ‘Simplest’ solution’, that box was already checked. Re the other solution: the ‘Always open with the selected program’ device appears to work, but when I try to export from SCID, even if I’ve selected only two or three games I get ‘File too big’ messages for both Notepad and MS Word, with the latter saying file is larger than 512 MB (2,358,526 KB)!
  
Back to top
 
IP Logged
 
cathexis
Full Member
***
Offline


No matter where you go,
there you are.

Posts: 233
Joined: 03/03/20
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #19 - 04/25/21 at 17:19:39
Post Tools
Bingo!

"So easy even a caveman could do it."

Now it generates a perfectly readable file I can scroll through to my hearts content. That was dragged over to my Kindle into the "downloads" directory then,  open Amazon Silk browser, open downloads, tap and up she comes. More than satisfied.

Great help and super fast too - Thx AOC!
  
Back to top
 
IP Logged
 
an ordinary chessplayer
God Member
*****
Offline


I used to be not bad.

Posts: 1175
Location: Columbus, OH (USA)
Joined: 01/02/15
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #18 - 04/25/21 at 16:35:03
Post Tools
Sure, so many ways to do it. Here's one:
  • Double-click help.txt file to open it in notepad.
  • On the menu click File ! Save As...
  • In the File name box change help (or help.txt) to "help.html" - use double-quotes in the new name - very important!
  • Click Save

note (1) If you have your view options set to the default Hide extensions for known file types, then the box says help. If you changed that setting, the box says help.txt.

note (2) Using double-quotes tells Windows "exactly what I typed". Otherwise it will add .txt to the end and typing help.html (without quotes) will give you help.html.txt. And if your extensions are hidden, you will see help.html but it's not really an .html file.
  
Back to top
 
IP Logged
 
cathexis
Full Member
***
Offline


No matter where you go,
there you are.

Posts: 233
Joined: 03/03/20
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #17 - 04/25/21 at 16:11:31
Post Tools
I cannot figure out how to do that in Win10, Edge.  Aargh! Renaming the link fails. I cut n pasted into both .txt & .docx so I have the raw .tcl help file, now what? How did you do that? Step by step for this Noob, if you please.
  
Back to top
 
IP Logged
 
an ordinary chessplayer
God Member
*****
Offline


I used to be not bad.

Posts: 1175
Location: Columbus, OH (USA)
Joined: 01/02/15
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #16 - 04/25/21 at 15:50:04
Post Tools
Michael Ayton wrote on 04/25/21 at 11:19:41:
I can export games to a pgn text file from CB Reader; whereas in CB 8.0, if I block some selected games and go Output-Textfile, the ChessX association is again created.

I was with you right up until this last part, but this doesn't match the other information you gave. I was thinking you have Windows set for the default "Hide file extensions for known types", and ChessX has associated .pgn files with itself. So when you say ChessX file, that would be the same as pgn file. Then you threw this last sentence in, which is totally inconsistent with my mental model.

Usually when you install a new program, there is a checkbox in Setup which says "Register file type", and you uncheck that box if you have some other preferred program already registered to the file type. So if you installed ChessX after ChessBase and didn't uncheck the box, that explains how ChessX messed up your file association.

Simplest: In ChessBase, click Tools ! Options ! Misc, check the box for Register PGN, click OK.

Other programs may have a similar menu option for capturing the file type.

More complicated: In Windows Explorer, click Tools ! Folder Options ! View, scroll down the list and uncheck the box Hide file extensions for known types, click OK. You can change it back later if it bothers you. Then find a .pgn file. Right-click, choose Open With, click Choose... If you don't see the one you want, in older Windows click Browse and find the .exe wherever it might be, in newer Windows click the shy down-arrow to show all the programs installed. Once your favorite program is selected, check the box Always open with the selected program, click OK.

For myself, I associate .pgn with notepad++ (great text editor on Windows). In notepad++ if you tell it .pgn is a pascal (or ada, etc.) source file then it will even do some nice color syntax highlighting for you. Or if notepad++ is not available (not my PC for example), I use notepad (not great but guaranteed to be available). If I want to open a pgn in a chess program (could be a different program every time), I can open that program first and then use Open from the menu. I don't like MS Word or similar for text files because it/they may insert formatting which I don't want.
  
Back to top
 
IP Logged
 
an ordinary chessplayer
God Member
*****
Offline


I used to be not bad.

Posts: 1175
Location: Columbus, OH (USA)
Joined: 01/02/15
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #15 - 04/25/21 at 15:02:52
Post Tools
cathexis wrote on 04/25/21 at 13:03:26:
a copy of the Help File I could download as a separate .pdf or even .txt file

Scid help as a single file is here:
https://github.com/benini/scid/blob/github/tcl/help/help.tcl
You can open it in a browser. In some places the formatting will be weird. Safari refused to open it, but I renamed it from help.tcl to help.html and then it opened.
  
Back to top
 
IP Logged
 
cathexis
Full Member
***
Offline


No matter where you go,
there you are.

Posts: 233
Joined: 03/03/20
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #14 - 04/25/21 at 13:03:26
Post Tools
Follow-up,

No probs D/L'ing SCID. But, no surprise, the documentation is extensive. It would be huge if I could find a copy of the Help File I could download as a separate .pdf or even .txt file. My resources are a desktop PC and a kindle. I have an Android phone but that is NOT for reading large help files ( at least in my universe). I do most non-print reading off the kindle as it is convenient (chair or bed). I see there is plenty of You-Tube and web-based resources. Is there a way to get the Help file as a separate .pdf for download to my kindle (I can drag n drop it from PC to kindle)? I looked and haven't found even a separate .txt copy of it.

TIA,
Cathexis
  
Back to top
 
IP Logged
 
Michael Ayton
God Member
*****
Offline


‘You’re never alone with
a doppelgänger.’

Posts: 1892
Location: durham
Joined: 04/19/03
Gender: Male
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #13 - 04/25/21 at 11:19:41
Post Tools
All these resources have their potential detractions, but I also do like SCID. But can anyone answer me this? I have, on my rather memory-bereft PC, a right mix of ancient and modern stuff: ChessBase 8.0(!), ChessBase Reader 2017, SCID 7.0.0, ChessX 1.5.4.0, Arena 3.5.1. The other day I downloaded a big games database (the 3.45m one mentioned by AOC in reply #1) and thought I’d saved it so it could open in CB Reader: but there, no games appear, and the database, which carries the ChessX icon, instead does open in SCID. Also, if I try to export filtered games from SCID to a pgn file, a similar ‘ChessX’ file is created, whereas I want files that I can save and edit in MS Word. It seems that ChessX is creating an association with these files that I don’t want. How can I stop this without deleting ChessX (assuming that even doing that would change things)?

By contrast, I can export games to a pgn text file from CB Reader; whereas in CB 8.0, if I block some selected games and go Output-Textfile, the ChessX association is again created.
  
Back to top
 
IP Logged
 
an ordinary chessplayer
God Member
*****
Offline


I used to be not bad.

Posts: 1175
Location: Columbus, OH (USA)
Joined: 01/02/15
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #12 - 04/25/21 at 05:59:41
Post Tools
@Jupp53 - I know you use Scid, just like you know I use the command line. Smiley

The ability to handle huge databases is where Scid shines. According to Fulvio Benini, the most recent maintainer of Scid, this is Shane Hudson's genius to make a database format that is so fast when opening and working with huge databases. Since Fulvio is familiar with the codebase, I take his word on that. The same 550MB .pgn file that locked up my computer trying to open in a text editor, Scid opened and converted to .si4 format in 14 seconds. I just checked, since it is now in Scid format, the same database re-opens in less than one second.
  
Back to top
 
IP Logged
 
Jupp53
God Member
*****
Offline


be

Posts: 976
Location: Frankfurt/Main
Joined: 01/04/09
Gender: Male
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #11 - 04/24/21 at 21:11:21
Post Tools
@cathexis

Thank you. The problem with chessbase is the time it needs to load a pgn-file with several hundredthousand games. At least in my laptop this lasts a day.

@aoc

Thanks. I will try SCID. It has no problem importing several million pgn-games.
  

Medical textbooks say I should be dead since April 2002.
Dum spiro spero. Smiley
Narcissm is the humans primary disease.
Back to top
 
IP Logged
 
an ordinary chessplayer
God Member
*****
Offline


I used to be not bad.

Posts: 1175
Location: Columbus, OH (USA)
Joined: 01/02/15
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #10 - 04/24/21 at 20:09:04
Post Tools
an ordinary chessplayer wrote on 04/24/21 at 19:07:38:
N.B. This implies my Scid filter in the previous post was not correct!

Right, I made two mistakes. (a) Putting Rated in the first box + Classical in the second box was finding games with Classical in the Opening tag. (b) We can't find Rapid and Classical in one OR filter, we need two separate filter operations.

So to correctly filter the way Jupp53 requested, in Scid
  • Search ! Header
  • White Rating = 2400 - 4000
  • Black Rating = 2400 - 4000
  • PGN contains text = "Rated Rapid" (all in the first box)
  • Operation on current filter = IGNORE (Reset filter)
  • Search - I got 8,314 / 604K
  • In the Database Switcher drag and drop from lichess_elite_2020_03 to the <clipbase>
  • In the Game List, click Change_filter (2nd button)
  • Click Reset (1st button)
  • Search ! Header
  • leave the Rating fields the same
  • PGN contains text = "Rated Classical" (all in the first box)
  • Operation on current filter = IGNORE (Reset filter)
  • Search - I got 117 / 604K
  • In the Database Switcher drag and drop from lichess_elite_2020_03 to the <clipbase>

Now the clipbase has 8,431 games, which seems correct.

@cathexis - You should investigate Scid. It's free! And it's the best at handling huge databases. But the user interface is not really that nice. So you could use it as a filter: Import a huge database, filter like I showed above, export a smaller database, then open the small database in your preferred ChessBase Reader 2017 and/or Fritz. I often use Scid in exactly this way, except my preferences are HIARCS Chess Explorer on macOS, Chess Studio on iPad, Wine+Chess Assistant on Linux, and (rarely) ChessBase on Windows.
  
Back to top
 
IP Logged
 
an ordinary chessplayer
God Member
*****
Offline


I used to be not bad.

Posts: 1175
Location: Columbus, OH (USA)
Joined: 01/02/15
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #9 - 04/24/21 at 19:07:38
Post Tools
Some statistics on lichess_elite_2021-03.pgn. Of course I used the command line...

top White|BlackElo
3364

count by Event
Blitz 573,495
Rapid 30,193
Classical 630
N.B. This implies my Scid filter in the previous post was not correct!

top 3 TimeControl by Event (see attached file for all of them)
Blitz   180+ 0  ( 430075 )
Blitz   180+ 2  ( 94156 )
Blitz   300+ 0  ( 38223 )
Rapid   480+ 0  ( 1231 )
Rapid   600+ 0  ( 24393 )
Rapid   600+ 5  ( 1082 )
Classical   900+15  ( 129 )
Classical  1500+ 0  ( 148 )
Classical  1800+ 0  ( 131 )


I would have expected increment to be more popular. Since I don't play online at all, I can only guess why that's not the case. One guess is that people would rather win on time than by good moves. Another guess is that with increment people just play on and on without resigning.

I remember when I got my first digital clock, I wanted to switch from 5-minute blitz to 3-minute with 2-second delay (not increment). My theory was that blitz with delay would help me practice for tournament games with delay. But everybody else just wanted to stick with 5-0, so I never got to test my theory.
  

t3s.txt ( 4 KB | 14 Downloads )
Back to top
 
IP Logged
 
an ordinary chessplayer
God Member
*****
Offline


I used to be not bad.

Posts: 1175
Location: Columbus, OH (USA)
Joined: 01/02/15
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #8 - 04/24/21 at 17:16:19
Post Tools
Jupp53 said no command line because otherwise I would have suggested it. Smiley

First, my statistics were wrong. My guesstimate was correct, but I confused myself by how I did my guesstimate. It's "only" 600K games per month at the moment, only 2x in the past year. Still I had to use the command line to investigate the March 2021 elite database. I tried to open it in a GUI text editor and it froze my system. 8GB RAM is not enough for a 552.5MB text file, apparently.

Second, the database already excludes bullet games.

The Event tag contains the following values:
So to filter the way Jupp53 requested, in Scid
  • Search ! Header
  • White Rating = 2400 - 4000
  • Black Rating = 2400 - 4000
  • PGN contains text = Rated + Rapid
  • Operation on current filter = IGNORE (Reset filter)
  • Search (New Filter) - I got 8,314 / 604K
  • leave the Rating fields the same
  • PGN contains text = Rated + Classical
  • Operation on current filter = OR (Add to filter)
  • Search - I got 24,600

Now you could copy those games to the Clipbase, add them to a new "2400RapidClassical" database, etc. Of course you could change the filter settings in other ways depending on your needs. What I couldn't figure out how to do in Scid is delete all the games in the current filter. There may be a way, but it's not in the menu, nor could I discover it by right-clicking.

If anybody is dreaming of importing the data from lichess.org instead of from database.nikonoel.fr, you are sure to run into some problems no matter what database you use. For example:
Quote:
Q: Why aren’t the URLs of the games included?
A: lichess stores the URLs of the games in the “Site” tag. Unfortunately scid has a limit on the number of different sites which can be stored in a database which is reached pretty fast if each game has its own site. I decided to delete the URLs to be able to use the files in scid. From June 2020 I kept the URLs under a new tag called “LichessURL”.
  
Back to top
 
IP Logged
 
cathexis
Full Member
***
Offline


No matter where you go,
there you are.

Posts: 233
Joined: 03/03/20
Re: Chessbase Reader 2017 with non-chessbase DBs?
Reply #7 - 04/24/21 at 14:40:28
Post Tools
I'm glad you chimed in, Jupp!

Checking what I do have - Chessbase Reader 2017 does have a tab set for Tournaments/Type which allow you to select/deselect Blitz and Rapid, but not Bullet. However, the better choice for this is to bring up Fritz 17/Database tile ('cause that's the only version I have), then you have access to a tile not in the Reader, "Edit Games." That will allow you to edit by player strength (Filter Game/Game Data) and Time (Filter Games/Time).

I'm used to thinking of command line as in the old MS Dos 5.0 command line - and more or less in subsequent Windoze versions. But perhaps the above is what you meant. Either way, it raises the question of whether sorting functions are limited for basic Fritz and/or Reader? So I would find much more sorting ability in the full Chessbase Mega database package? Which I would expect to be true. IOW, no matter how massive the DB is, if sorting/search functions are limited by the program itself you're using to access the DB in the first place, than one could still be missing a lot.

Thanks!
Cathexis
  
Back to top
 
IP Logged
 
Page Index Toggle Pages: [1] 2 
Topic Tools
Bookmarks: del.icio.us Digg Facebook Google Google+ Linked in reddit StumbleUpon Twitter Yahoo