The authors tested a self-created Ovid Embase cost-effectiveness analysis (CEA) search filter, compared to six other published filters designed to identify economic evaluations in Embase. In this filter validation study, sensitivity, precision and specificity were measured against a gold standard set of economic evaluations derived from the National Health Service Economic Evaluation Database (NHS EED). The set was populated with NHS EED citations published in 2008-2013 that were also available in Ovid Embase (n = 2,198). Testing of the CEA filter resulted in a sensitivity of 0.899 and precision of 0.029. No filter achieved the stated objective of achieving a sensitivity of at least 0.90 with a precision of 0.10, and specificity of at least 0.95, although one tested filter was close to achieving that objective. The authors conclude that it is challenging to develop economic search filters that balance sensitivity and precision. Choice of filter should be based on the researcher’s acceptable levels of performance.