<br><br><div class="gmail_quote">2009/9/11 Pekka Klärck <span dir="ltr"><<a href="mailto:peke@iki.fi">peke@iki.fi</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
2009/9/10 Laurent Ploix <<a href="mailto:laurent.ploix@gmail.com">laurent.ploix@gmail.com</a>>:<br>
<div class="im">> 2009/9/10 Pekka Klärck <<a href="mailto:peke@iki.fi">peke@iki.fi</a>><br>
</div><div class="im">>> 2009/7/29 Laurent Ploix <<a href="mailto:laurent.ploix@gmail.com">laurent.ploix@gmail.com</a>>:<br>
>> ><br>
</div><div class="im">>> > As far as I understand:<br>
>> > - Robot will take a number of scenarios, and for each of them, it will<br>
>> > stop<br>
>> > at the first error/failure.<br>
>><br>
>> It's true that the framework stops executing a single tests when a<br>
>> keyword it executes fails. These keyword can, however, internally do<br>
>> as many checks it wants and decide when to stop. We are also planning<br>
>> to add support to continue execution after failures in the future [1].<br>
>><br>
> Well, for me, this looks like a very annoying thing. I prefer to see the<br>
> fixture (library) being in charge of accessing the tested software (doing<br>
> sg, extracting data from it), and the framework being in charge of checking<br>
> the validity of the returned data.<br>
<br>
</div>How can any generic framework know what data is valid without someone<br>
telling it?<br></blockquote><div> </div><div>Because, in the scenario that you describe, you tell the framework which data you expect. </div><div><br></div><div>like</div><div><br></div><div>fixture Add</div><div>op1 | op2 | result?</div>
<div>1 | 2 | 3</div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
<div class="im"><br>
> In other terms, I would like to do sg like:<br>
> - Do something<br>
> - Extract data x, y, z and check that x=1, y=2, z=3<br>
> ... with the scenario describing the expected data, the fixture extracting<br>
> data x, y, z, and the framework telling me if that's correct data or not<br>
> (with a report).<br>
<br>
</div>You can do all this with Robot Framework but the actual verification<br>
is always done on libraries. The framework has many built-in keywords<br>
for verifications, but even when you use them the framework is still<br>
just executing keywords and catching possible exceptions.<br></blockquote><div> </div><div>Understood. But I don't find that convenient.</div><div><br></div><div>Let me take an example.</div><div><br></div><div>You test a software that calculates lots of data. You want to see what data is wrong.</div>
<div><br></div><div>I find I much more convenient to have </div><div>- a fixture that extracts calculated data (but does not verification), </div><div>- a scenario that tells you what data you want to extract and what result you expect</div>
<div>- a framework that matches both and create a report</div><div><br></div><div>Then, you get many good things for free:</div><div>- You don't have to code any verification logic in the fixture. Fixtures tend to be simpler (i.e. : get the input, do action, get outputs)</div>
<div>- You can see how many failures you get; which ones, etc... (it's meaningful to see how many failures you have. Having one wrong data or all of them does not involve same type of debug)</div><div><br></div><div>
My 2 cents</div>
<div><br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
<div><div></div><div class="h5"><br>
Cheers,<br>
.peke<br>
--<br>
Agile Tester/Developer/Consultant :: <a href="http://eliga.fi" target="_blank">http://eliga.fi</a><br>
Lead Developer of Robot Framework :: <a href="http://robotframework.org" target="_blank">http://robotframework.org</a><br>
</div></div></blockquote></div><br><br clear="all"><br>-- <br>Laurent Ploix<br><br><a href="http://lauploix.blogspot.com/">http://lauploix.blogspot.com/</a><br>