**:** ..,

..
**:**
**:** 89
**:** -
**:** 2021
**:** .., .. // . 89. .: , 2021. .45-72. DOI: https://doi.org/10.25728/ubs.2021.89.2

** :** , ,

** (.):** expert appraisals, test question, point ratio

**:** . , . . , . , . . . . .

** (.):** The article proposes the existence of an objective component of the complexity of the problem which is experimentally verified and proposes the point ratio which is introduced and experimentally studied. For this purpose, the so-called "point coefficient" is introduced and experimentally investigated, which allows us to estimate the level of complexity of the problem given in the form of a test questions. This coefficient is based on the answers to these questions that the level of complexity of the problem is estimated. Hypotheses describing the dynamics of changes in the values of the point coefficient are proposed and experimentally tested. Also, the stability of the obtained conclusions based on the results of calculations for two qualitatively different coefficients relative to the number of respondents was checked. The criterion for determining the test question as a problem of the third level of complexity is experimentally found and tested. The reason for this is the nature of the change in the range of the spread of the values of the histogram coefficient. An experimental study of the presence of cognitive distortions in the assessment of some test tasks by experts was conducted. Possible directions for further development are proposed.

PDF
: 1131, : 237, : 2.