Tater said:
Stoney since you seem to be well versed on the topic of double blind tests perhaps you can outline the proper procedure for me and clear up my ignorance.
Double Blind testing makes it impossible for either the test subjects or the person administering the test to bias the experiment.
Here's an example of how it could be done with a taste test for weed.
1. First develop a scoring card for use by the test subject. A new card would be filled out for each separate test of each sample. The card would have something like:
A)Is the flavor in sample "A" better than sample "B"?
B)Is sample "A" more harsh tasting than sample "B"?
***
This is only one of the questions. The samples are of identically grown crops with documentation that proves the grow was identical and REPEATABLE. Being able to repeat the testing is just about the most important part of the Scientific Method. If another Scientist can't perform the exact same test using your documentation, then your testing was flawed.
In the samples given the test subjects, the person who labels them is NOT the person who gives the test. The labeler has a precise method of creating the test samples and they also HAVE to be recorded as Test-1, Test-2, etc.
One test might have the same crop in both samples.
The next test might also be of the same crop.
The next might be "A" is crop one, "B" is crop two.
The next might be "A" is crop two, "B" is crop one.
The next might be the same crop again.
Then the next one might be the same crop, but the other crop.
***
This goes on for SEVERAL HUNDRED tests. The mixing and matching is done by the labeler and recorded on every single test.
The results are reported as: "Crop One was chosen as the best flavor in 86% of the tests. Crop two was chosen as the most harsh in 93% of the tests." The scores that are in the high 80's and 90% area are the ones that prove the point.
If the results show "Crop One was chosen as the best flavor in 35% of the tests, Crop Two was chosen as the best flavor in 42% of the tests and Crop One as both parts of the test was shown to be the best flavor in 10% of the tests and finally Crop Two as both parts of the test was shown to be the best flavor in 13% of the tests, then, it would prove that there really wasn't much difference between the two crops in terms of flavor.
Each set of tests has to have nearly the same standards at the start. The same number of hours of rest. The same foods or lack of foods prior to the test, so that the taste buds are not affected by other factors.
The number of tests, the number of test subjects, the controls, and the number of switches of "A" and "B" make it virtually impossible to have any sort of bias appear on the test results.
This is why testing such as this is expensive and done by persons with grants or funding sources. It simply can't be done properly by someone at "Home".
As many as a thousand test subjects are used with each taking tests on days spanning as much as a year.
Taste tests are very, very precise. They show, by a huge compilation of evidence that one taste is better or worse than another as tested by many, many, many people.
Universities have an advantage in Double Blind testing because of their resources to test subjects and money.
***
That said, you're entirely correct in saying that taste reports by individuals at home, knowing which weed has been flushed or not and having no testing standards what-so-ever, are meaningless.
The anecdotal remark of "Well I grew some in the same room the following crop and didn't flush and it tasted like bear crap" is funny, but has absolutely no validity as a test.
Sooner or later, someone at one of the Universities is going to do a taste test on Medical MJ.
That's the one I'll be very interested in reading the results of.
If nutrient salts arrive in the flower of the buds or in the leaf matter itself is interesting, but won't prove anything regarding the taste. Only a taste test will do that, and only a Double Blind taste test will do it with repeatable results that can be referred to as Scientific Method.
I still don't believe that nutrient salts actually arrive in the flower itself or in the leaf, other than in the veins within the leaf.
Your salts test will show that. It'll be interesting to see the results. To be accepted results, they have to be repeated by at least two separate testing facilities, or again, it falls outside of Scientific Method.