m-ric HF Staff commited on
Commit
f572763
·
1 Parent(s): 3811036

Improve prompt further

Browse files
Files changed (1) hide show
  1. e2bqwen.py +14 -13
e2bqwen.py CHANGED
@@ -128,23 +128,24 @@ final_answer("Done")
128
  ```<end_code>
129
  </task_resolution_example>
130
 
131
- <guidelines>
132
- Always wait for appropriate loading times
 
 
 
 
 
 
 
 
133
  Use precise coordinates based on the current screenshot
134
- Execute one action at a time: don't try to pack several clicks in one action.
135
  On each step, look at the last screenshot and action to validate if previous steps worked and decide the next action. If you repeated an action already without effect, it means that this action is useless: don't repeat it and try something else.
136
  Use click to move through menus on the desktop and scroll for web and specific applications.
137
- When clicking an element, always make sure to click THE MIDDLE of that element! Else you risk to miss it.
138
  Always analyze the latest screenshot carefully before performing actions. Make sure to:
139
- 1. Look at elements on the screen to determine what to click or interact with
140
- 2. Use precise coordinates for mouse movements and clicks
141
- 3. You can wait for page loads or animations to complete using the wait() tool
142
- 4. Sometimes you may have missed a click, so never assume that you're on the right page, always make sure that your previous action worked. In the screenshot you can see if the mouse is out of the clickable area. Pay special attention to this.
143
- - Remember the tools that you have as those can save you time, for example open_url to enter a website rather than searching for the browser in the OS.
144
- - Whenever you click, MAKE SURE to click in the middle of the button, text, link or any other clickable element. Not under, not on the side. IN THE MIDDLE. In menus it is always better to click in the middle of the text rather than in the tiny icon. Calculate extremelly well the coordinates. A mistake here can make the full task fail.
145
- - To navigate the desktop you should open menus and click. Menus usually expand with more options, the tiny triangle next to some text in a menu means that menu expands. For example in Office in the Applications menu expands showing presentation or writing applications.
146
- - Always analyze the latest screenshot carefully before performing actions.
147
- </guidelines>
148
  """
149
 
150
  def draw_marker_on_image(image, click_coordinates):
 
128
  ```<end_code>
129
  </task_resolution_example>
130
 
131
+ <click_guidelines>
132
+ Look at elements on the screen to determine what to click or interact with.
133
+ Use precise coordinates for mouse movements and clicks. When clicking an element, ALWAYS CLICK THE MIDDLE of that element, not UNDER OR ABOVE! Else you risk to miss it.
134
+ Sometimes you may have missed a click, so never assume that you're on the right page, always make sure that your previous action worked. In the screenshot you can see if the mouse is out of the clickable area. Pay special attention to this.
135
+ Remember the tools that you have as those can save you time, for example open_url to enter a website rather than searching for the browser in the OS.
136
+ Whenever you click, MAKE SURE to click in the middle of the button, text, link or any other clickable element. Not under, not on the side. IN THE MIDDLE. In menus it is always better to click in the middle of the text rather than in the tiny icon. Calculate extremelly well the coordinates. A mistake here can make the full task fail.
137
+ </click_guidelines>
138
+
139
+ <general_guidelines>
140
+ You can wait for appropriate loading times using the wait() tool. But don't wait forever, sometimes you've just misclicked and the process didn't launch.
141
  Use precise coordinates based on the current screenshot
142
+ Execute one action at a time: don't try to pack a click and typing in one action.
143
  On each step, look at the last screenshot and action to validate if previous steps worked and decide the next action. If you repeated an action already without effect, it means that this action is useless: don't repeat it and try something else.
144
  Use click to move through menus on the desktop and scroll for web and specific applications.
 
145
  Always analyze the latest screenshot carefully before performing actions. Make sure to:
146
+ To navigate the desktop you should open menus and click. Menus usually expand with more options, the tiny triangle next to some text in a menu means that menu expands. For example in Office in the Applications menu expands showing presentation or writing applications.
147
+ Always analyze the latest screenshot carefully before performing actions.
148
+ </general_guidelines>
 
 
 
 
 
 
149
  """
150
 
151
  def draw_marker_on_image(image, click_coordinates):