Sign In:     

Forum: Old versions

Topic: Error when trying to recurse - Page: 1

This part of topic is old and might contain outdated or incorrect information

I have 30k + files all in one folder on an external HDD, the files are all in one folder "Karaoke Tracks" the size of this folder is 220gb and is in a 400gb partition,
I went through the process of "Add to searchable DB" when this was done I then did a recurse on the same folder, all seemed to be going well untill I got the error message "Not enough quota to process this command"
I am running Windows XP
And virtualdj 6.0.7 trial
Was using PCDJKJ but liked the appearance and features of Virtual dj
Any help on this issue would really be appreciated, otherwise I might as well go back to what I was using
Cheers guys
 
Posted Sun 02 May 10 @ 3:55 pm
I find it hard to believe I have not had one comment on this issue ????
 
With 30k+ files in a single folder, why would you recurse...?

The Recurse option brings all files from sub-folders up to the current level. As you have no subfolders maybe you are confusing the hell out of VDJ!! - Just a thought.

As long as all the files have been added to the database, VDJ should return searches almost instantaneously. I have over 100k files on an external HDD and tracks are returned as I type. Near instant results every time.

Cheers,

Roy
 
Sorry, I have not explained it clearly enough
I do have 30k+ files and they are all within a folder called Karaoke files, but they are not all individual tracks. The actual path might read as follows
K:/Karaoke Files/Sunfly/Sunfly Hits/Sunfly - 123/Song Name

I was only recently introduced to Virtual DJ and liked the appearance and the search facility, but if I can't get it to work I might as well stick with my old software.

Please tell me if I have understood the process correctly, when you select a folder (Karaoke Tracks) and select "Add to search DB" this only searches the first layer of folders, then by selecting to "Recurse" the same folder (Karaoke Tracks) the search will then look down the whole path right down to the ID3 tag

Thanks for taking time to advise me
Dave T
 
This is not the case...

If you add a parent folder to the DB it will automatically scan the sub folders. Then each track included in a potential search.

Recurse brings all the files from all the sub-folders and makes them appear as if they are in the parent folder.

You should not recurse unless you have to. I use recurse when I know a song exists in a particular folder structure but can't remember enough of the title for it to be searched for correctly.

If you are still having search issues then we need to look in to your metadata in more detail and look at how you store your karaoke files.

All this will help you understand how VDJ works more.

We're all here to help.

Roy
 
Thanks for your reply Roy, that does seem to explain a few things.

I saw Virtual DJ being used a few weeks ago and asked the guy about it, I know the guy was busy doing his gig, but he told me that I could download a free fully working trial of VDJ, and basically told me to just to locate the folder my files where in and select add to db, then go back to the same folder and select recurse.
As you see this has caused me confusion, as the recurse is not normally needed.

I typed in * in the search bar to see all files and noticed that some are listing as "Track 01" etc, so can VDJ actually find the identlty of the song within such file from the ID3 tag ??

Cheers mate
DaveT
 
 
You need to make sure you have the tags in the MP3 of course ;-)

You also mentioned that these are karaoke files. How have you got them organised?

Cheers,

Roy
 
My tracks are in a folder called "Karaoke Tracks" in there they are sorted into manfacturer ie Sunfly, Sound Choice, Zoom etc etc
if applicable thier range, Hits, Most Wanted, Specials. then into the CD ID/Number then into a zipped folder containing the cgd & mp3 files.
So a typical path could read as follows.
Drive name........................ K
My Folder.......................... Karaoke Tracks
Manufacturer Name............. Sunfly
Manufacturer Catorgary........ Most Wanted
Manufacturer Disc ID........... SMW - 123
Manufacturer Contents........ Track 01-Song Title+Artist Name (zipped - containing both cgd & mp3 files)

Here is an actual file path that I copied to show you what might be the longest path,
File Path = K:\Karaoke Tracks\Zoom\Zoom - Karaoke Hits\ZMH01\ZMH01 - 15 - E L O - Sweet Talkin Woman.zip

I hope the above details are good enough to explain things.

As Stated in my earlier post I noticed When I typed in * to the search bar for a full listing of the data base I saw items for the artist as Track 01 etc, I'm thinking that the search would not actually show the contents of this type of listing
So let's assume that The listing that shows Track 01 when dragged to the deck was Lulu - Shout.
If I typed in a search for "Shout" would I be correct is saying the search would not reveal it ?

Dave T
 
If you unzip one of these, say the one in your example, and then look at the tag information do you see all the correct details?

You can, in windows, right click on the MP3, select properties and then advanced and it will present you with the ID3 tag information.

Cheers,

Roy
 
Hi Roy

If I search for "Sweet Talkin Woman" in VDJ as shown in the path example it does find this one.

If I search Track, then look for an example giving no details this is what I see.

In VDJ under artist it reads "Track 10 " under "Title" 10

If I select it and then "Files Infos" this is the details I can See

File Name = Sttw1336-10 - Erasure - Sometimes.mp3
Artist = 10
Title = Track 10

I then searched for Erasure, and look down the list it does show the above details of Track 10 - 10, obviously I wouldn't have a clue what this file actually contained.

Dave T
 
So basically your MP3 files have not been tagged. The searches are only coming from the detail in the filenames...

There are tools for tagging karaoke files as well as good tools for tagging MP3's - I happen to use MediaMonkey.

Just search these forums for more info.

To speed things up, your gonna need a tool that will update the tags from the filenames. MediaMonkey does this but not from zipped files.

You may have quite a task on your hand. Worse case scenario you may need to re-rip the CD's and ensure the title/artist fields are pre-filled.

Cheers,

Roy
 
Hi Roy, and thanks again for taking time to help me and share your knowledge.

As you say, it appears that I could have 100's if not 1000's of files that are missing any id3 tag info, I have found many tracks listed as track 01,02 etc and some just saying Artist Unknown, just the thought of having to process them all makes me cringe.

Anyway, apart from that, can you explain the differance of what info would be in the DB when I just select the folder and select "Add To Searchable DB" and what additional info is added when I select "Recurse" on the same folder.
I loaded the instructions for VDJ 607 and searched for the word Recurse, to my surprise it is NOT even listed, hence I am finding it difficult to find out what Recurse actully does. And going back to my original post, I am still at a loss as to why I am getting the error message "Not enough quota to process this command" when I try to recurse.

I spoke to the guy that sold me all the discs and hdd, and he said that he didn't have this error message when he had it on his system, the only differance being he was running a version 5 of VDJ and I have downloaded the newer version 6.0.7

So now I am thinking is it some change in the versions or does my PC have some setting preventing it from carrying out the recurse.

God my brain hurts.

Cheers mate
Dave T
 
Dave_T_UK wrote :
Hi Roy, and thanks again for taking time to help me and share your knowledge.


No problem...

Dave_T_UK wrote :
Anyway, apart from that, can you explain the differance of what info would be in the DB when I just select the folder and select "Add To Searchable DB" and what additional info is added when I select "Recurse" on the same folder.


OK... Recurse brings all the files from the sub folders, under the folder you "recurse" and makes them appear as if they are in in the this folder. The equivalent filter folder would be filepath starts with "K:\Karaoke Files\" which is probably more efficient than a recurse...

"Add to seach DB" does exactly what it says on the tin... It will add all the file from the current folder, and sub folders, to the VDJ database, which in this case would be stored in the root of the K: drive.

However if, as we have discovered, the MP3s have little or no meaningful tag information so you are not going to be able to search for much...

Dave_T_UK wrote :
And going back to my original post, I am still at a loss as to why I am getting the error message "Not enough quota to process this command" when I try to recurse.


I'll let a teamer respond to this error message, but to me it sounds like a memory issue, but that's just my own opinion!

Dave_T_UK wrote :
I spoke to the guy that sold me all the discs and hdd, and he said that he didn't have this error message when he had it on his system, the only differance being he was running a version 5 of VDJ and I have downloaded the newer version 6.0.7


There are soooooooo many thing that could be different between your setup and his that I could reel off 101 things that could explain why things do or don't work in different systems - Heck, even identitcal off the shelf PC's could give different results based on how the user has configured it!!!!

Dave_T_UK wrote :
So now I am thinking is it some change in the versions or does my PC have some setting preventing it from carrying out the recurse.


Highly doubt it... Try creating the filter folder I suggested above and see if that works.

Dave_T_UK wrote :
God my brain hurts.


Don't worry we'll get there...

Roy
 
Hi Roy

Before I create the filter folder as you suggest, does VDJ have a facility that shows how many files/tracks are in the DB, as I would then be able to see if any more info has been found.
I know that by typing * into the search bar will list all the DB contents, but there is NO WAY I am going to attempt to count them like that LMAO

So to date my DB status is as follows,
Because when I added one folder (Karaoke Tacks - 220gb) then recurse, I got the error
I thought I'd split the folder into Karaoke Tracks 1 and 2 (approx 110gb each)
And add to DB then, recurse them separately
I added them both...all went ok, then I started a recurse on the first, Karaoke tracks 1 and about 50% through it, the error message came up.

I am thinking that I should delete the VDJ DB xml files that I have in My documents and the one on the external drive, then try doing the filter folder as you suggest, or even remove VDJ and re install it.

I will wait to here from you as to if this would be the best way forward, also an idiots guide to setting up this filter folder would be greatly appreciated.

Dave T
 
The filter folder method Roy suggested is the best way as all information is accessed from the Virtual DJ database (which is loaded at startup). This makes the whole operation very quick and shouldn't cause problems.

Recursing scans each directory for its files and then checks for information in the database - this is very slow as every directory must be accessed individually; if your files are already in the search database you are more than doubling Virtual DJ's workload as disk io operations are very expensive (in resource terms).


As for your questions:

To see how many tracks Virtual DJ has catalogued click on the Config button (top right) and then enter the Browser tab. At the bottom of this section exist some database tools and it will display how many tracks Virtual DJ has indexed (is searchable).

To add the filter folder click on the blue folder icon of Virtual DJ's browser (left of screen where you browse for folders). Give it whatever name you find appropriate (e.g. Karaoke) and use the filter in the format suggested by Roy (filepath starts with "K:\Karaoke Files\") where the location in brackets is wherever your Karaoke files are stored.
 
Hi Andrew

Thanks for your comments

So what do I need to do here
Right let's assume I have removed any folders that I have added to search DB, and that VDJ is as a re install

Dave T
 
In Virtual DJ's browser locate the folder where your music is located (you may wish to right-click on it and add it as a favourite if not done so already although this is optional). Right-click on the folder and select add to search db, Virtual DJ will pop up a small window and quickly index all of the files. Once this procedure has completed click on the blue folder icon with the plus on it, this will allow you to create a new filter folder.

Under name enter whatever will help you recognise what the filter aims to achieve, e.g. 'Karaoke'
Under filter enter filepath starts with "E:\Music\Karaoke" (note that the location here will be dependent on your filepath)

Once you've completed the setup of the filter folder you can select it normally in Virtual DJ and it will have almost identical functionality as recurse but should be much quicker and error free.
 
Sorry that I have not replied sooner, I've have prob's with me PC (Virus/Trojan etc, courtesy of facebook) and could not even load up the VDJ forum, I am at work using one of there PC's.
I will be reseting my PC back to factory settings tomorrow. When everything is done I will try the filter folder and report back as sonn as poss
Cheers guys
Dave T
 
I would just like to say a BIG thanks to Gadgetman & Andrew87 for thier help and guidance on this issue, I feel this is about as far as it can go and say that it has reached it's conclusion.
Cheers Guys and Thanks Again

Dave T
 
74%