A Framework to Evaluate Cognitive Complexity in Mathematics Assessments

Error message

  • Deprecated function: Creation of dynamic property MemCacheDrupal::$bin is deprecated in MemCacheDrupal->__construct() (line 30 of /home/438674.cloudwaysapps.com/juvzwavpcj/public_html/docroot/sites/all/modules/memcache/memcache.inc).
  • Deprecated function: Creation of dynamic property MemCacheDrupal::$wildcard_flushes is deprecated in MemCacheDrupal->reloadVariables() (line 637 of /home/438674.cloudwaysapps.com/juvzwavpcj/public_html/docroot/sites/all/modules/memcache/memcache.inc).
  • Deprecated function: Creation of dynamic property MemCacheDrupal::$invalidate is deprecated in MemCacheDrupal->reloadVariables() (line 638 of /home/438674.cloudwaysapps.com/juvzwavpcj/public_html/docroot/sites/all/modules/memcache/memcache.inc).
  • Deprecated function: Creation of dynamic property MemCacheDrupal::$cache_lifetime is deprecated in MemCacheDrupal->reloadVariables() (line 639 of /home/438674.cloudwaysapps.com/juvzwavpcj/public_html/docroot/sites/all/modules/memcache/memcache.inc).
  • Deprecated function: Creation of dynamic property MemCacheDrupal::$cache_flush is deprecated in MemCacheDrupal->reloadVariables() (line 640 of /home/438674.cloudwaysapps.com/juvzwavpcj/public_html/docroot/sites/all/modules/memcache/memcache.inc).
  • Deprecated function: Creation of dynamic property MemCacheDrupal::$cache_content_flush is deprecated in MemCacheDrupal->reloadVariables() (line 641 of /home/438674.cloudwaysapps.com/juvzwavpcj/public_html/docroot/sites/all/modules/memcache/memcache.inc).
  • Deprecated function: Creation of dynamic property MemCacheDrupal::$cache_temporary_flush is deprecated in MemCacheDrupal->reloadVariables() (line 642 of /home/438674.cloudwaysapps.com/juvzwavpcj/public_html/docroot/sites/all/modules/memcache/memcache.inc).
  • Deprecated function: Creation of dynamic property MemCacheDrupal::$flushed is deprecated in MemCacheDrupal->reloadVariables() (line 643 of /home/438674.cloudwaysapps.com/juvzwavpcj/public_html/docroot/sites/all/modules/memcache/memcache.inc).
Monday, April 30, 2018Printer-friendly version

Download a PDF of the brief here.

Around the country, vendors are approaching states and making claims that their summative mathematics assessments are aligned to state standards, such as the Common Core. These claims are easy to make, yet difficult for state employees to confirm. To assist states in their efforts to establish the accuracy of such claims, Achieve has been working to develop a methodology and tools to evaluate the quality and alignment of assessments, building from the earlier review work of the Thomas B. Fordham Institute and the Human Resources Research Organization (HumRRO).

In this process, Achieve recognized an opportunity to forward the national conversation on higher-order thinking as an aspect of assessment evaluation. The most popular framework for this purpose is Webb’s Depth of Knowledge (DOK), which places items on a scale from 1 to 4, from recall to extended thinking. However, most of the current state standards expect students to evidence procedural skills and fluencies, conceptual understandings, and applications, and DOK is not able to distinguish or emphasize these elements. These “Aspects of Rigor” represent a beneficial shift that was promoted by the Common Core and should apply to assessment as well as standards.