[Closed] Fast search through text file

depends on how do you plan to use it.
if you’re sure that words that aren’t in the list shouldn’t be collected why adding them? go with the preinitialized dict
it is all about the performance
if there’s no much difference collect everything and then retrieve from the dict by the key, then of course you’ll have to keep else statement

…
just to be clear, if you go with the predifined dict you won’t have —- key in the dict after you process the file.
.

upd
this one, must be the fastest version so far. ~45ms

public class Line
{
	public int count = 0;
	public List<string> lines;
	public List<int> indexes;
	
	public Line()
	{
		count = 0;
		lines   = new List<string>(){};
		indexes = new List<int>();
	}
	
	
	public Line( string line, int index )
	{
		count   = 1;
		lines   = new List<string>(){ line };
		indexes = new List<int>(){ index };
	}
	
	public void AddLine( string line, int index )
	{
		lines.Add( line );
		indexes.Add( index );
		count++;
	}
}

public class TextProcessor
{
	public Dictionary<string, Line> data;
	public string[] keys;
	public Line[] lines;
	
	public void ProcessFile(string file , string[] words)
	{	
		data = new Dictionary<string, Line>();
		
		//foreach( var w in words) data[w] = new Line();
		
		var spaces = new char[]{' ','	','\r','\n'};
		string[] lines = File.ReadAllLines(file);

		if (lines != null)
		{
			int line_index = 0;
			
			string word;
			
			foreach(string line in lines)
			{
				line_index++;
				
				// #1
				//word = line.TrimStart(spaces).Split()[0].ToLower();
				
				// #2
				//word = line.TrimStart(spaces);
				//int len  = word.IndexOfAny( spaces );
				//word = word.Substring( 0, len < 0 ? word.Length : len ).ToLower();
				
				// #3
				//var chars = line.ToCharArray();						
				//int f1 = Array.FindIndex(chars,     x => !char.IsWhiteSpace(x));						
				//if ( f1 < 0 ) continue;						
				//int f2 = Array.FindIndex(chars, f1, x => char.IsWhiteSpace(x));
				//word = line.Substring( f1, f2 - f1 ).ToLower();
				
				// #4						
				int f1 = -1;
				for ( int i = 0; i < line.Length; i++ )
				{
					if ( !char.IsWhiteSpace(line[i]) )
					{
						f1 = i;
						break;
					}
				}
				
				if ( f1 < 0 ) continue;
				int f2 = -1;
				for ( int i = f1; i < line.Length; i++ )
				{
					if ( char.IsWhiteSpace(line[i]) )
					{
						f2 = i;
						break;
					}
				}
				word = line.Substring( f1, f2 - f1 ).ToLower();
										
				if (data.ContainsKey(word))
				{
					data[word].AddLine( line, line_index );							
				}
				else
				{
					data[word] = new Line( line, line_index );							
				}
			}
		}
		keys = new string[data.Keys.Count];
		data.Keys.CopyTo(keys, 0);				
		this.lines = new Line[data.Values.Count];
		data.Values.CopyTo(this.lines, 0);
	}
	
}

Fixed, thank you.

For now everything works as expected – fast and accurate.

To make navigating in scripts more user friendly.
You know that Ctrl+RMB click gives you a menu where you can see the controls, functions, events, etc. used in the current script and you can go whenever you want by clicking the desired item.
When I see whole screen(literally) full with items to click, and there are more items not shown… not an easy task to find what you need.
So, I created this:

2023-01-17 22_59_56.png462×800 38.1 KB

For the currently opened script, the [ </> ] shows, buttons for all available controls + local and global vars + struct names + functions + lines where I have format and print. Clicking a button shows the data. Clicking a row in the list shows the line number of the selected text, double clicking a row selects the same line in the MaxScript editor and make it visible, so navigation is easy and fast.
The button with the bookmark icon shows all bookmarks for the current script. The navigation is the same – click a row in the list to go to desired bookmark.
The [ /* ] button shows all comments which starts with –. The same way of navigation.
With the filter box I can find what I need much faster.
And most importantly, with your help and the help of the Denis collecting the data is much faster than Ctrl+RMB click inside the MaxScritp Editor.

What I have in my ToDo list:

• collect variables inside structs
• find a faster way to populate the listview. It takes more than 1,5 sec to fill it with 4000+ items.

Thank you.
I use vscode for Pyhton and Powershell, but I can’t force myself to use it(along with notepad++) for maxscript.

Thank you. Will check it in the coming days. First I have to “fix and arrange” the code of the whole script.

Yes. The functions, defined inside structs, are collected by the script, but the variables does not start with local or global, so they are not collected.