Trading system optimization, even with a limited set of parameters, involves a huge search space. Harmony Search Optimization solves the problem.
An example of a 5-Fold Cross-Validation study to investigate the robustness of a simple systematic trading strategy.
My biggest fear is to be fooled by randomness: curve-fitting is the enemy hidden in plain sight. Cross-validation can be our ally, but there are plenty of challenges to overcome.