FileData - Reading Samples from a Text (ASCII) File

FileData - Reading Samples from a Text (ASCII) File
Note: This feature requires version 03-25-2003 or newer.

SPC Express can read samples that are being written dynamically to a text file by other software. Here's how it works:

The disk file must be named FileData.txt by default. If you need to use a different file name, you can over-ride the default by defining the file name in the Special Instructions field for that characteristic. (Click on Edit / EditTheCurrentCharacteristic / Optional Info Tab)
Example: *Filedata=whatever.txt or *Filedata=C:\Scratch\SPC.txt
You may also specify the filename globally by typing FILEDATA=C:\SPC\whatever.txt into the Extra Options field (*NOTE 1*) in Global Preferences.
Notes:
- The File is assumed to be located in the "working path" (Start-in folder), unless otherwise specified.
- The File Name must either end with .txt or have a comma after it. In most cases, you MUST put a comma after the file name. So please add a comma just to be safe!!
- You can only be processing one text file at a time, meaning you can't have two different characteristics processing two different text files at the same time.
  As of 02-20-2013:
  Each Page can (must) have its own text file name defined. If more than one page is being used, each page must point to a DIFFERENT text file. Note: If you want the old behavior (treat all pages together) use the new Special Option "FileDataPages=ALL".
- A common problem is that the file gets named FileData.txt.txt (with two extensions). Look in your Windows Explorer Tools / Folder Options / View and BE SURE that the checkbox called "Hide extensions for known file type" IS NOT CHECKED!
- You may also specify a "Variable" filename, like this:
  *Filedata=H:\SPCXW\[FldName].txt
  and if STARTQUERY=[FldName] is specified, that entered value will be substituted in.
The file should contain records terminated with Carriage Returns just as if they were readings from an electronic gage. The same formatting rules apply.
NOTE: Maximum file length = 1,000 records or 15,000 bytes, whichever is less.
As of 10-27-2004, these numbers have been increased to 1,200 and 250,000.
To tell SPC Express to read the file, set your Comm Port to 7 (baud rate, parity, etc don't matter). Get to this set-up screen by clicking Edit / EditTheCurrentCharacteristic / Input Options Tab. You can specify either a sample starting byte position or a field number. This works great for Excel-type CSV (Comma Separated Values) files. To specify a field number, just add 700. Example: Use 704 to indicate that you want the 4th field. (It is assumed the commas are used to separate the fields.) Note: Text file data can also use SemiColons (or Tabs) as Delimiters instead of Commas. Simply put FileDataDelimiter=SEMICOLON (or TAB) (*NOTE 1*) in your Extra Options field.
As of 08-31-2010, the GageID Position can also be a field number, like 702, instead of just a byte position.
Set the Special Option (use the 'Extra Options' field in File / Global Preferences): FileTimer=ON (*NOTE 1*) This causes the text file to be scanned every 2 seconds for new data.
When a Characteristic is first opened and it uses Comm Port 7, you will be asked if you want to delete the existing FileData.txt file. Normally you will say 'No'. You can have this 'No' answer be automatic by specifying the Special Option FileDataStart=KEEP (*NOTE 1*) You may find that it works out best if you delete the file when you're done processing it (see next bullet). Whether you delete it or not, SPC Express will start scanning at the beginning of the file (unless you click 'Cancel'). If you do NOT delete it, you may be processing the same samples twice. That is why you are given the opportunity to delete the existing file. If you DO choose 'Cancel', the SPC file will be opened but the text File will not be read for processing. You would typically do this if you just needed to open the SPC file for editing and didn't want to process any new data.
LAYOUTS: If you were just processing one characteristic, you would not need to use a Layout. But, when two or more charactertistics are involved, you MUST put them into a Layout and then activate that Layout. The reason for this is because if you activated one charactertistic at a time, as soon as the first one became active, SPC Express would start reading the text file, and by the time you activated the next charactertistic, SPC Express would be reading way down in the text file (if not completely done!) and the second charactertistic would have missed seeing the first records in the text file. So, by putting all your charactertistics into a Layout and then activating that Layout, SPC Express is smart enough to hold off reading the text file until all characteristics have been opened.
Once SPC Express starts reading the file, it continues until it reaches the end of the file. When it reaches the end, it stops processing records and waits 2 seconds before checking for new records again. If the Special Option FileDataDone=DELETE (*NOTE 1*) is set, then the text file will be deleted after the last record has been processed.
A typical FileData.txt file might look something like this: Dia1 ##Date##09/12/2003## (optional - see note below) Dia1 ##Time##10:45:00## (optional - see note below) Dia1 ##LotNumber##123## (optional - see note below) Dia1 = 1.250 Dia2 = 2.750 Length = 4.575 Dia1 = 1.255 Dia2 = 2.745 Length = 4.537 Dia1 = 1.225 Dia2 = 2.740 Length = 4.562
Notes:
- If Date and Time are absent, the current time will be used.
- You can define "traceability" data using ## as shown above. If other Traceability fields are absent then that trace field will be blank unless the "P" flag is set.
- Normally, a record can contain sample value(s), or one traceability value, but not both. UNLESS you use the Special Option "FileDataTrace=" (see below).
  ALSO, there is a new special 'trick' that will allow you to put one traceability value in a record which also contains sample value(s). Do this by putting a third # sign in the third delimiter, like this: ##Operator##Sally###
  An example of such a record would be:
  DIA = 1.234 WID = 5.123 ##Operator##Sally### 12/18/2014 9:45:00 am
- WATCH OUT! If the record starts with leading spaces, the byte count will start at the first non-blank.
Another possible file format could be (3 characteristics per record): Test 1, 09/30/2003, 09:15:00 AM, 1.25, 2.88, 3.125 Test 1, 09/30/2003, 09:30:00 AM, 1.26, 2.74, 3.133 Test 1, 09/30/2003, 09:45:00 AM, 1.28, 2.76, 3.127 Test 1, 09/30/2003, 10:00:00 AM, 1.22, 2.90, 3.129 Test 1, 09/30/2003, 10:15:00 AM, 1.24, 2.81, 3.131
For the file format above, you could set Special Options (*NOTE 1*) :
FileDataDate=9 indicating that the Date - 10 characters long - starts in byte position 9
FileDataDate8=9 indicating that the Date - 8 characters long - starts in byte position 9
FileDataTime=21 indicating that the Time - 11 characters long - starts in byte position 21

You can also have SPC Express find the Date & Time fields automatically ....
FileDataDate=Auto finds the Date based on the first slash ( / ) in the record - must be 10 characters mm/dd/yyyy.
FileDataTime=Auto finds the Time based on the first colon ( : ) in the record - ex: 7:45, 16:45, 12:15:30 08:00 pm.

Note: You can also specify the Timestamp location by Field Number (70n) instead of byte position.
(requires version 02-15-2006 or newer)
Another possible format is if you have several samples for the same feature all in one record:
(requires version 12-30-2005 or newer)
Width , 09/30/2003, 09:15:00 AM, 1.01, 1.02, 1.03 Width , 09/30/2003, 09:30:00 AM, 1.04, 1.05, 1.06 Length, 09/30/2003, 09:15:00 AM, 5.01, 5.02, 5.03 Length, ##Operator##Bob## Length, ##Lot Number##12345## Length, 09/30/2003, 09:30:00 AM, 5.03, 5.04, 5.05
(Subgroup size = 3)

SPC Express will read all of the samples in a given record and put them into the same characteristic. To do this, specify the 'Position of Sample' to be 704 and the 'No. of characters in the Sample' to be 706.
Another Method for specifing where your samples are located in the text file is called "FileData Chapter Processing" (requires version 11-14-2008 or newer). It is especially useful for processing data files coming from CMM machines. For more information on "FileData Chapter Processing" click here.
Special Notes on Attribute files (requires version 12-05-2011 or newer):
If you want to process data for an Attribute Characteristic, there are few special things to be aware of:
All data should be entered by utilizing the Traceability feature, like this:
ID ##No of pcs##201## ID ##Desc_#1##Rusty## ID ##Count_#1##1## ID ##Desc_#2##Cracked## ID ##Count_#2##2## ID ##Desc_#3##Bent## ID ##Count_#3##3## ID ##NC PCS##4## ID ##SUBGROUP STATUS##COMPLETE## 12/03/2011 07:02
Note that NC PCS is optional. If specified, then this value will be used. Otherwise the value will be the simple sum of all the Non-conformities. Use "No of Pcs" instead of "# of Pcs". The last record in the data file sequence should be SUBGROUP STATUS and set to "Complete". This is the only way that SPC Express will know that you have finished specifying data for that subgroup. The above example assumes you have specified FileDataDate=AUTO, FileDataTime=AUTO
Added a new Special Option: FileDataTrace=[Operator]:98:4 for allow for trace data to be extracted from FileData (text file) records. In this example, it will extract data starting at byte 98 for 4 bytes. Note: Only ONE traceability field can be specified using this technique. If you need to specify multiple traceabilty fields, use the ##TraceName##TraceContent## method instead.
Use Multiple text files:
You can now specify a text file on a per characteristic basis. For example, you could have 4 characteristics open on a page and specify that each of those 4 characteristics process a different text file. To do this, enter this into the Special Instructions field of each characteristic:
FileData=C:\data\filename1.txt:1
FileData=C:\data\filename2.txt:2
FileData=C:\data\filename3.txt:3
FileData=C:\data\filename4.txt:4
and each of the 8 pages can have 4 different text files.

If you choose to utilize this feature, you should REMOVE any reference to FILEDATA= in the Extra Options field in Global Preferences. Also, on the 6th tab in Global Preferences, blank out the field named Text File Name (Optional).
Caution: If multiple files are specified, the GageIDs that are in those text files should be unique - as every record in every file is available to all visible windows.

This feature requires version 06-24-2018 or newer.
Halting a Run-away Text File:
If a text file is being read and "runs away", the user can hold down BOTH the Left Ctrl and Left Shift keys to bring up the Port 7 Pause/Resume dialog. This would give the user a chance to close the characteristics or delete the text file, or otherwise correct the problem.

This feature requires version 10-02-2020 or newer.

*NOTE 1*:
These options should now be entered on the "Sounds & FileData" tab of Global Preferences instead of typing them into the Extra Options field.

Note: Use of the Sounds Tab requires version 01-09-2013 or newer.