python 3.x - How to use Boto3 pagination -


background:

the aws operation list iam users returns max of 50 default.

reading docs (links) below ran following code , returned complete set data setting "maxitems" 1000.

paginator = client.get_paginator('list_users') response_iterator = paginator.paginate(  paginationconfig={      'maxitems': 1000,      'pagesize': 123}) page in response_iterator:     u = page['users']     user in u:         print(user['username'])

http://boto3.readthedocs.io/en/latest/guide/paginators.html https://boto3.readthedocs.io/en/latest/reference/services/iam.html#iam.paginator.listusers

question:

if "maxitems" set 10, example, best method loop through results? the

i tested following loops 2 iterations before 'istruncated' == false , results in "keyerror: 'marker'". not sure why happening because know there on 200 results.

marker = none  while true:     paginator = client.get_paginator('list_users')     response_iterator = paginator.paginate(          paginationconfig={             'maxitems': 10,             'startingtoken': marker})     #print(response_iterator)     page in response_iterator:         u = page['users']         user in u:             print(user['username'])             print(page['istruncated'])             marker = page['marker']             print(marker)         else:             break

thanks.

(answer rewrite) **note **, paginator contains bug doesn't tally documentation (or vice versa). maxitems doesn't return marker or nexttoken when total items exceed maxitems number. indeed pagesize 1 controlling return of marker/nexttoken indictator.

import sys import boto3 iam = boto3.client("iam") marker = none while true:     paginator = iam.get_paginator('list_users')     response_iterator = paginator.paginate(          paginationconfig={             'pagesize': 10,             'startingtoken': marker})     page in response_iterator:         print("next page : {} ".format(page['istruncated']))         u = page['users']         user in u:             print(user['username'])     try:         marker = page['marker']         print(marker)     except keyerror:         sys.exit()

it not mistake code doesn't works. maxitems in paginator seems become "threshold" indicator. ironically, maxitems inside original boto3.iam.list_users still works mentioned.

if check boto3.iam.list_users, notice either omit marker, otherwise must put value. apparently, paginator not wrapper boto3 class list_* method. 

import sys import boto3 iam = boto3.client("iam") marker = none while true:     if marker:         response_iterator = iam.list_users(             maxitems=10,             marker=marker         )     else:         response_iterator = iam.list_users(             maxitems=10         )     print("next page : {} ".format(response_iterator['istruncated']))     user in response_iterator['users']:         print(user['username'])      try:         marker = response_iterator['marker']         print(marker)     except keyerror:         sys.exit()

you can follow the issue filed in boto3 github. according member, can call build_full_result after paginate(), show desire behavior.


-

Comments

Post a Comment

Popular posts from this blog

amazon web services - S3 Pre-signed POST validate file type? -

i know it's possible put limit on file size content-length-range header. possible validate file type? https://docs.aws.amazon.com/amazons3/latest/dev/httppostforms.html#policyconditions i see there content-type header, if set say, audio/mp3 allow mp3 files , return error if file not mp3? i found previous question answers mention validating file size: s3 direct upload restricting file size , type you can specify content-type @ post request. you can specify @ signature, post must done content-type: { "expiration": "2007-12-01t12:00:00.000z", "conditions": [ {"acl": "public-read" }, {"bucket": "johnsmith" }, {"content-type: "audio/mp3"} ] } creating html form (using aws signature version 4) edit: @ previous question found, checking content-type.
Read more

c# - Check Keyboard Input Winforms -

i wondering if instead of doing this protected override void onkeydown(keyeventargs e) { if (e.keycode == keys.a) console.writeline("the key down."); } i set bool method , this: if(keydown(keys.a)) // whatever here i've been sitting here ages trying figure out how it. can't wrap head around it. in case wondering, plan call bool inside different method, check input. since want perform action after pressing key, using keydown event enough. but in cases suppose want check if specific key down in middle of process, can use getkeystate method way: [dllimport("user32.dll", charset = charset.auto, exactspelling = true)] public static extern short getkeystate(int keycode); public const int key_pressed = 0x8000; public static bool iskeydown(keys key) { return convert.toboolean(getkeystate((int)key) & key_pressed); } you should know, each time check key state using example iskeydown(keys.a) method returns true if ke...
Read more