Obliterate and Clean  are no longer working

Crowdstrike Artifacts (i.e., Reports, Actors) are not deleted after performing Obliterate and Clean  functions  functions.

Use of -f has no impact on outcomes
Have tried bulk --obliterate and individual -ca, -ca, ci, -ct

[2023-03-31 19:01:30,364] INFO     processor/main       Start clean up of CrowdStrike Adversary (BAT) events from MISP.
[2023-03-31 19:01:30,518] INFO     processor/main       Completed deletion of CrowdStrike BAT adversaries within MISP in 0.15 seconds
[2023-03-31 19:01:30,518] INFO     processor/main       Start clean up of CrowdStrike Adversary (BEAR) events from MISP.
[2023-03-31 19:01:30,607] INFO     processor/main       Completed deletion of CrowdStrike BEAR adversaries within MISP in 0.08 seconds
[2023-03-31 19:01:30,607] INFO     processor/main       Start clean up of CrowdStrike Adversary (BUFFALO) events from MISP.
[2023-03-31 19:01:30,693] INFO     processor/main       Completed deletion of CrowdStrike BUFFALO adversaries within MISP in 0.08 seconds
[2023-03-31 19:01:30,693] INFO     processor/main       Start clean up of CrowdStrike Adversary (CHOLLIMA) events from MISP.
[2023-03-31 19:01:30,795] INFO     processor/main       Completed deletion of CrowdStrike CHOLLIMA adversaries within MISP in 0.10 seconds
[2023-03-31 19:01:30,795] INFO     processor/main       Start clean up of CrowdStrike Adversary (CRANE) events from MISP.
[2023-03-31 19:01:31,177] INFO     processor/main       Completed deletion of CrowdStrike CRANE adversaries within MISP in 0.38 seconds
[2023-03-31 19:01:31,177] INFO     processor/main       Start clean up of CrowdStrike Adversary (JACKAL) events from MISP.
[2023-03-31 19:01:31,243] INFO     processor/main       Completed deletion of CrowdStrike JACKAL adversaries within MISP in 0.06 seconds
[2023-03-31 19:01:31,243] INFO     processor/main       Start clean up of CrowdStrike Adversary (HAWK) events from MISP.
[2023-03-31 19:01:31,368] INFO     processor/main       Completed deletion of CrowdStrike HAWK adversaries within MISP in 0.12 seconds
[2023-03-31 19:01:31,368] INFO     processor/main       Start clean up of CrowdStrike Adversary (KITTEN) events from MISP.
[2023-03-31 19:01:31,487] INFO     processor/main       Completed deletion of CrowdStrike KITTEN adversaries within MISP in 0.11 seconds
[2023-03-31 19:01:31,487] INFO     processor/main       Start clean up of CrowdStrike Adversary (LEOPARD) events from MISP.
[2023-03-31 19:01:31,585] INFO     processor/main       Completed deletion of CrowdStrike LEOPARD adversaries within MISP in 0.09 seconds
[2023-03-31 19:01:31,585] INFO     processor/main       Start clean up of CrowdStrike Adversary (LYNX) events from MISP.
[2023-03-31 19:01:31,700] INFO     processor/main       Completed deletion of CrowdStrike LYNX adversaries within MISP in 0.11 seconds
[2023-03-31 19:01:31,700] INFO     processor/main       Start clean up of CrowdStrike Adversary (OCELOT) events from MISP.
[2023-03-31 19:01:31,829] INFO     processor/main       Completed deletion of CrowdStrike OCELOT adversaries within MISP in 0.12 seconds
[2023-03-31 19:01:31,830] INFO     processor/main       Start clean up of CrowdStrike Adversary (PANDA) events from MISP.
[2023-03-31 19:01:32,007] INFO     processor/main       Completed deletion of CrowdStrike PANDA adversaries within MISP in 0.17 seconds
[2023-03-31 19:01:32,007] INFO     processor/main       Start clean up of CrowdStrike Adversary (SPIDER) events from MISP.
[2023-03-31 19:01:32,222] INFO     processor/main       Completed deletion of CrowdStrike SPIDER adversaries within MISP in 0.21 seconds
[2023-03-31 19:01:32,222] INFO     processor/main       Start clean up of CrowdStrike Adversary (TIGER) events from MISP.
[2023-03-31 19:01:32,340] INFO     processor/main       Completed deletion of CrowdStrike TIGER adversaries within MISP in 0.11 seconds
[2023-03-31 19:01:32,340] INFO     processor/main       Start clean up of CrowdStrike Adversary (WOLF) events from MISP.
[2023-03-31 19:01:32,476] INFO     processor/main       Completed deletion of CrowdStrike WOLF adversaries within MISP in 0.13 seconds
[2023-03-31 19:01:32,476] INFO     processor/main       Finished cleaning up CrowdStrike related events from MISP, 0 events deleted.

python3 misp_import.py -f -nb -d --obliterate

😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱

@@@  @@@  @@@   @@@@@@   @@@@@@@   @@@  @@@  @@@  @@@  @@@   @@@@@@@@  @@@
@@@  @@@  @@@  @@@@@@@@  @@@@@@@@  @@@@ @@@  @@@  @@@@ @@@  @@@@@@@@@  @@@
@@!  @@!  @@!  @@!  @@@  @@!  @@@  @@!@!@@@  @@!  @@!@!@@@  !@@        @@!
!@!  !@!  !@!  !@!  @!@  !@!  @!@  !@!!@!@!  !@!  !@!!@!@!  !@!        !@
@!!  !!@  @!@  @!@!@!@!  @!@!!@!   @!@ !!@!  !!@  @!@ !!@!  !@! @!@!@  @!@
!@!  !!!  !@!  !!!@!!!!  !!@!@!    !@!  !!!  !!!  !@!  !!!  !!! !!@!!  !!!
!!:  !!:  !!:  !!:  !!!  !!: :!!   !!:  !!!  !!:  !!:  !!!  :!!   !!:
:!:  :!:  :!:  :!:  !:!  :!:  !:!  :!:  !:!  :!:  :!:  !:!  :!:   !::  :!:
 :::: :: :::   ::   :::  ::   :::   ::   ::   ::   ::   ::   ::: ::::   ::
  :: :  : :     :   : :   :   : :  ::    :   :    ::    :    :: :: :   :::

😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱 😱

Obliterate is a destructive operation that will remove all CrowdStrike data
from your MISP instance. There is no going back once this process completes.

Are you sure you want to do this?

[Enter 'yes' to continue] ==> yes

         _.-^^---....,,---;
     _--/                  `--_
    <                        >)
    |        KA-BOOM!         |
     \._                   _./
        ```--. . , ; .--'''
              | |   |
           .-=||  | |=-.
           `-=#$%&%$#=-'
              | ;  :|
     _____.,-#%&$@%#&#~,._____
         COMMAND  ACCEPTED

[2023-03-31 19:16:11,848] INFO     misp_tools    MISP Import for CrowdStrike Threat Intelligence v0.6.8
[2023-03-31 19:16:11,849] INFO     config  CHECK CONFIG
[2023-03-31 19:16:11,850] DEBUG    config  client_id                                   value redacted, check config file
[2023-03-31 19:16:11,850] DEBUG    config  client_secret                               value redacted, check config file
[2023-03-31 19:16:11,850] DEBUG    config  crowdstrike_url                             US1
[2023-03-31 19:16:11,850] DEBUG    config  api_request_max                             5000
[2023-03-31 19:16:11,850] DEBUG    config  api_enable_ssl                              True
[2023-03-31 19:16:11,850] DEBUG    config  reports_timestamp_filename                  lastReportsUpdate.dat
[2023-03-31 19:16:11,850] DEBUG    config  indicators_timestamp_filename               lastIndicatorsUpdate.dat
[2023-03-31 19:16:11,850] DEBUG    config  actors_timestamp_filename                   lastActorsUpdate.dat
[2023-03-31 19:16:11,850] DEBUG    config  init_reports_days_before                    365
[2023-03-31 19:16:11,850] DEBUG    config  init_indicators_minutes_before              300
[2023-03-31 19:16:11,850] DEBUG    config  init_actors_days_before                     365
[2023-03-31 19:16:11,850] DEBUG    config  reports_unique_tag                          CrowdStrike: REPORT
[2023-03-31 19:16:11,850] DEBUG    config  indicators_unique_tag                       CrowdStrike: INDICATOR
[2023-03-31 19:16:11,851] DEBUG    config  actors_unique_tag                           CrowdStrike: ADVERSARY
[2023-03-31 19:16:11,851] DEBUG    config  reports_tags                                att:source="Crowdstrike.Report"
[2023-03-31 19:16:11,851] DEBUG    config  indicators_tags                             att:source="Crowdstrike.Indicators"
[2023-03-31 19:16:11,851] DEBUG    config  actors_tags                                 att:source="Crowdstrike.Actors"
[2023-03-31 19:16:11,851] DEBUG    config  unknown_mapping                             CrowdStrike:indicator:galaxy: UNATTRIBUTED
[2023-03-31 19:16:11,851] DEBUG    config  unattributed_title                          Unattributed indicators:
[2023-03-31 19:16:11,851] DEBUG    config  indicator_type_title                        Indicator Type:
[2023-03-31 19:16:11,851] DEBUG    config  malware_family_title                        Malware Family:
[2023-03-31 19:16:11,851] DEBUG    config  log_duplicates_as_sightings                 True
[2023-03-31 19:16:11,851] DEBUG    config  misp_url                                    https://3samisp
[2023-03-31 19:16:11,851] DEBUG    config  misp_auth_key                               value redacted, check config file
[2023-03-31 19:16:11,851] DEBUG    config  crowdstrike_org_uuid                        ca4f4b5d-db04-4a5e-a6de-e60636dc01be
[2023-03-31 19:16:11,851] DEBUG    config  misp_enable_ssl                             False
[2023-03-31 19:16:11,851] WARNING  config  misp_enable_ssl                             SSL is disabled for MISP API requests
[2023-03-31 19:16:11,851] DEBUG    config  ind_attribute_batch_size                    2500
[2023-03-31 19:16:11,851] DEBUG    config  event_save_memory_refresh_interval          180
[2023-03-31 19:16:11,851] DEBUG    config  max_threads                                 16
[2023-03-31 19:16:11,851] DEBUG    config  miss_track_file                             no_galaxy_mapping.log
[2023-03-31 19:16:11,851] DEBUG    config  galaxies_map_file                           galaxy.ini
[2023-03-31 19:16:11,851] DEBUG    config  tag_unknown_galaxy_maps                     True
[2023-03-31 19:16:11,851] DEBUG    config  taxonomic_kill-chain                        True
[2023-03-31 19:16:11,851] DEBUG    config  taxonomic_information-security-data-source  True
[2023-03-31 19:16:11,851] DEBUG    config  taxonomic_type                              True
[2023-03-31 19:16:11,851] DEBUG    config  taxonomic_iep                               False
[2023-03-31 19:16:11,851] DEBUG    config  taxonomic_iep2                              True
[2023-03-31 19:16:11,852] DEBUG    config  taxonomic_iep2_version                      False
[2023-03-31 19:16:11,852] DEBUG    config  taxonomic_tlp                               True
[2023-03-31 19:16:11,852] DEBUG    config  taxonomic_workflow                          True
[2023-03-31 19:16:12,753] INFO     config  No configuration errors found (1 warning)
[2023-03-31 19:16:12,753] INFO     config
[2023-03-31 19:16:12,753] INFO     config  ____ _  _ ____ ____ _  _ ____    ___  ____ ____ ____ ____ ___
[2023-03-31 19:16:12,753] INFO     config  |    |__| |___ |    |_/  [__     |__] |__| [__  [__  |___ |  \
[2023-03-31 19:16:12,753] INFO     config  |___ |  | |___ |___ | \_ ___]    |    |  | ___] ___] |___ |__/
[2023-03-31 19:16:12,753] INFO     config
[2023-03-31 19:16:14,174] INFO     processor/main       BEGIN DELETE
[2023-03-31 19:16:14,174] INFO     processor/main       Start clean up of CrowdStrike Adversary (BAT) events from MISP.
[2023-03-31 19:16:14,322] INFO     processor/main       Completed deletion of CrowdStrike BAT adversaries within MISP in 0.14 seconds
[2023-03-31 19:16:14,322] INFO     processor/main       Start clean up of CrowdStrike Adversary (BEAR) events from MISP.
[2023-03-31 19:16:14,467] INFO     processor/main       Completed deletion of CrowdStrike BEAR adversaries within MISP in 0.14 seconds
[2023-03-31 19:16:14,467] INFO     processor/main       Start clean up of CrowdStrike Adversary (BUFFALO) events from MISP.
[2023-03-31 19:16:14,599] INFO     processor/main       Completed deletion of CrowdStrike BUFFALO adversaries within MISP in 0.13 seconds
[2023-03-31 19:16:14,599] INFO     processor/main       Start clean up of CrowdStrike Adversary (CHOLLIMA) events from MISP.
[2023-03-31 19:16:14,691] INFO     processor/main       Completed deletion of CrowdStrike CHOLLIMA adversaries within MISP in 0.09 seconds
[2023-03-31 19:16:14,691] INFO     processor/main       Start clean up of CrowdStrike Adversary (CRANE) events from MISP.
[2023-03-31 19:16:14,895] INFO     processor/main       Completed deletion of CrowdStrike CRANE adversaries within MISP in 0.20 seconds
[2023-03-31 19:16:14,895] INFO     processor/main       Start clean up of CrowdStrike Adversary (JACKAL) events from MISP.
[2023-03-31 19:16:14,997] INFO     processor/main       Completed deletion of CrowdStrike JACKAL adversaries within MISP in 0.10 seconds
[2023-03-31 19:16:14,997] INFO     processor/main       Start clean up of CrowdStrike Adversary (HAWK) events from MISP.
[2023-03-31 19:16:15,240] INFO     processor/main       Completed deletion of CrowdStrike HAWK adversaries within MISP in 0.24 seconds
[2023-03-31 19:16:15,240] INFO     processor/main       Start clean up of CrowdStrike Adversary (KITTEN) events from MISP.
[2023-03-31 19:16:15,328] INFO     processor/main       Completed deletion of CrowdStrike KITTEN adversaries within MISP in 0.08 seconds
[2023-03-31 19:16:15,328] INFO     processor/main       Start clean up of CrowdStrike Adversary (LEOPARD) events from MISP.
[2023-03-31 19:16:15,432] INFO     processor/main       Completed deletion of CrowdStrike LEOPARD adversaries within MISP in 0.10 seconds
[2023-03-31 19:16:15,432] INFO     processor/main       Start clean up of CrowdStrike Adversary (LYNX) events from MISP.
[2023-03-31 19:16:15,516] INFO     processor/main       Completed deletion of CrowdStrike LYNX adversaries within MISP in 0.08 seconds
[2023-03-31 19:16:15,516] INFO     processor/main       Start clean up of CrowdStrike Adversary (OCELOT) events from MISP.
[2023-03-31 19:16:15,592] INFO     processor/main       Completed deletion of CrowdStrike OCELOT adversaries within MISP in 0.07 seconds
[2023-03-31 19:16:15,592] INFO     processor/main       Start clean up of CrowdStrike Adversary (PANDA) events from MISP.
[2023-03-31 19:16:15,753] INFO     processor/main       Completed deletion of CrowdStrike PANDA adversaries within MISP in 0.16 seconds
[2023-03-31 19:16:15,753] INFO     processor/main       Start clean up of CrowdStrike Adversary (SPIDER) events from MISP.
[2023-03-31 19:16:15,872] INFO     processor/main       Completed deletion of CrowdStrike SPIDER adversaries within MISP in 0.11 seconds
[2023-03-31 19:16:15,873] INFO     processor/main       Start clean up of CrowdStrike Adversary (TIGER) events from MISP.
[2023-03-31 19:16:15,992] INFO     processor/main       Completed deletion of CrowdStrike TIGER adversaries within MISP in 0.11 seconds
[2023-03-31 19:16:15,992] INFO     processor/main       Start clean up of CrowdStrike Adversary (WOLF) events from MISP.
[2023-03-31 19:16:16,133] INFO     processor/main       Completed deletion of CrowdStrike WOLF adversaries within MISP in 0.14 seconds
[2023-03-31 19:16:16,133] INFO     processor/main       Start clean up of CrowdStrike CSA report events from MISP.
[2023-03-31 19:16:16,252] INFO     processor/main       Completed deletion of CrowdStrike CSA reports within MISP in 0.11 seconds
[2023-03-31 19:16:16,252] INFO     processor/main       Start clean up of CrowdStrike CSAR report events from MISP.
[2023-03-31 19:16:16,405] INFO     processor/main       Completed deletion of CrowdStrike CSAR reports within MISP in 0.15 seconds
[2023-03-31 19:16:16,405] INFO     processor/main       Start clean up of CrowdStrike CSIR report events from MISP.
[2023-03-31 19:16:16,538] INFO     processor/main       Completed deletion of CrowdStrike CSIR reports within MISP in 0.13 seconds
[2023-03-31 19:16:16,538] INFO     processor/main       Start clean up of CrowdStrike CSDR report events from MISP.
[2023-03-31 19:16:16,646] INFO     processor/main       Completed deletion of CrowdStrike CSDR reports within MISP in 0.10 seconds
[2023-03-31 19:16:16,646] INFO     processor/main       Start clean up of CrowdStrike CSIT report events from MISP.
[2023-03-31 19:16:16,736] INFO     processor/main       Completed deletion of CrowdStrike CSIT reports within MISP in 0.08 seconds
[2023-03-31 19:16:16,736] INFO     processor/main       Start clean up of CrowdStrike CSGT report events from MISP.
[2023-03-31 19:16:16,868] INFO     processor/main       Completed deletion of CrowdStrike CSGT reports within MISP in 0.13 seconds
[2023-03-31 19:16:16,868] INFO     processor/main       Start clean up of CrowdStrike CSIA report events from MISP.
[2023-03-31 19:16:16,944] INFO     processor/main       Completed deletion of CrowdStrike CSIA reports within MISP in 0.07 seconds
[2023-03-31 19:16:16,944] INFO     processor/main       Start clean up of CrowdStrike CSQR report events from MISP.
[2023-03-31 19:16:17,192] INFO     processor/main       Completed deletion of CrowdStrike CSQR reports within MISP in 0.24 seconds
[2023-03-31 19:16:17,192] INFO     processor/main       Start clean up of CrowdStrike CSMR report events from MISP.
[2023-03-31 19:16:17,452] INFO     processor/main       Completed deletion of CrowdStrike CSMR reports within MISP in 0.26 seconds
[2023-03-31 19:16:17,452] INFO     processor/main       Start clean up of CrowdStrike CSTA report events from MISP.
[2023-03-31 19:16:17,553] INFO     processor/main       Completed deletion of CrowdStrike CSTA reports within MISP in 0.10 seconds
[2023-03-31 19:16:17,553] INFO     processor/main       Start clean up of CrowdStrike CSWR report events from MISP.
[2023-03-31 19:16:17,638] INFO     processor/main       Completed deletion of CrowdStrike CSWR reports within MISP in 0.08 seconds
[2023-03-31 19:16:17,639] INFO     processor/main       Start clean up of CrowdStrike TEST report events from MISP.
[2023-03-31 19:16:17,713] INFO     processor/main       Completed deletion of CrowdStrike TEST reports within MISP in 0.07 seconds
[2023-03-31 19:16:17,713] INFO     processor/main       Start clean up of CrowdStrike HASH_MD5 indicator events from MISP.
[2023-03-31 19:16:17,811] INFO     processor/main       Start clean up of CrowdStrike HASH_SHA256 indicator events from MISP.
[2023-03-31 19:16:17,897] INFO     processor/main       Start clean up of CrowdStrike HASH_SHA1 indicator events from MISP.
[2023-03-31 19:16:17,982] INFO     processor/main       Start clean up of CrowdStrike HASH_IMPHASH indicator events from MISP.
[2023-03-31 19:16:18,268] INFO     processor/main       Start clean up of CrowdStrike FILE_NAME indicator events from MISP.
[2023-03-31 19:16:18,355] INFO     processor/main       Start clean up of CrowdStrike FILE_PATH indicator events from MISP.
[2023-03-31 19:16:18,426] INFO     processor/main       Start clean up of CrowdStrike URL indicator events from MISP.
[2023-03-31 19:16:18,536] INFO     processor/main       Start clean up of CrowdStrike MUTEX_NAME indicator events from MISP.
[2023-03-31 19:16:18,618] INFO     processor/main       Start clean up of CrowdStrike BITCOIN_ADDRESS indicator events from MISP.
[2023-03-31 19:16:18,718] INFO     processor/main       Start clean up of CrowdStrike COIN_ADDRESS indicator events from MISP.
[2023-03-31 19:16:18,795] INFO     processor/main       Start clean up of CrowdStrike EMAIL_ADDRESS indicator events from MISP.
[2023-03-31 19:16:18,871] INFO     processor/main       Start clean up of CrowdStrike EMAIL_SUBJECT indicator events from MISP.
[2023-03-31 19:16:18,949] INFO     processor/main       Start clean up of CrowdStrike REGISTRY indicator events from MISP.
[2023-03-31 19:16:19,156] INFO     processor/main       Start clean up of CrowdStrike DEVICE_NAME indicator events from MISP.
[2023-03-31 19:16:19,336] INFO     processor/main       Start clean up of CrowdStrike DOMAIN indicator events from MISP.
[2023-03-31 19:16:19,466] INFO     processor/main       Start clean up of CrowdStrike CAMPAIGN_ID indicator events from MISP.
[2023-03-31 19:16:19,640] INFO     processor/main       Start clean up of CrowdStrike IP_ADDRESS indicator events from MISP.
[2023-03-31 19:16:19,724] INFO     processor/main       Start clean up of CrowdStrike SERVICE_NAME indicator events from MISP.
[2023-03-31 19:16:19,831] INFO     processor/main       Start clean up of CrowdStrike USER_AGENT indicator events from MISP.
[2023-03-31 19:16:19,928] INFO     processor/main       Start clean up of CrowdStrike PORT indicator events from MISP.
[2023-03-31 19:16:19,990] INFO     processor/main       Start clean up of CrowdStrike PASSWORD indicator events from MISP.
[2023-03-31 19:16:20,247] INFO     processor/main       Start clean up of CrowdStrike USERNAME indicator events from MISP.
[2023-03-31 19:16:20,377] INFO     processor/main       Start clean up of CrowdStrike X509_SERIAL indicator events from MISP.
[2023-03-31 19:16:20,509] INFO     processor/main       Start clean up of CrowdStrike X509_SUBJECT indicator events from MISP.
[2023-03-31 19:16:20,692] INFO     processor/main       Start clean up of CrowdStrike MD5 hashes indicator type events from MISP.
[2023-03-31 19:16:20,757] INFO     processor/main       Start clean up of CrowdStrike SHA256 hashes indicator type events from MISP.
[2023-03-31 19:16:20,849] INFO     processor/main       Start clean up of CrowdStrike SHA1 hashes indicator type events from MISP.
[2023-03-31 19:16:20,939] INFO     processor/main       Start clean up of CrowdStrike IMP hashes indicator type events from MISP.
[2023-03-31 19:16:21,133] INFO     processor/main       Start clean up of CrowdStrike File names indicator type events from MISP.
[2023-03-31 19:16:21,235] INFO     processor/main       Start clean up of CrowdStrike File directory paths indicator type events from MISP.
[2023-03-31 19:16:21,374] INFO     processor/main       Start clean up of CrowdStrike Web addresses indicator type events from MISP.
[2023-03-31 19:16:21,498] INFO     processor/main       Start clean up of CrowdStrike Mutexes indicator type events from MISP.
[2023-03-31 19:16:21,598] INFO     processor/main       Start clean up of CrowdStrike BTC addresses indicator type events from MISP.
[2023-03-31 19:16:21,715] INFO     processor/main       Start clean up of CrowdStrike BIC addresses indicator type events from MISP.
[2023-03-31 19:16:21,805] INFO     processor/main       Start clean up of CrowdStrike Email addresses indicator type events from MISP.
[2023-03-31 19:16:21,943] INFO     processor/main       Start clean up of CrowdStrike Email subjects indicator type events from MISP.
[2023-03-31 19:16:22,116] INFO     processor/main       Start clean up of CrowdStrike Registry key locations indicator type events from MISP.
[2023-03-31 19:16:22,210] INFO     processor/main       Start clean up of CrowdStrike Device host names indicator type events from MISP.
[2023-03-31 19:16:22,292] INFO     processor/main       Start clean up of CrowdStrike Web domains indicator type events from MISP.
[2023-03-31 19:16:22,355] INFO     processor/main       Start clean up of CrowdStrike Campaign IDs indicator type events from MISP.
[2023-03-31 19:16:22,445] INFO     processor/main       Start clean up of CrowdStrike IP addresses indicator type events from MISP.
[2023-03-31 19:16:22,581] INFO     processor/main       Start clean up of CrowdStrike Service names indicator type events from MISP.
[2023-03-31 19:16:22,726] INFO     processor/main       Start clean up of CrowdStrike User-Agent strings indicator type events from MISP.
[2023-03-31 19:16:22,896] INFO     processor/main       Start clean up of CrowdStrike TCP ports indicator type events from MISP.
[2023-03-31 19:16:22,964] INFO     processor/main       Start clean up of CrowdStrike Password credentials indicator type events from MISP.
[2023-03-31 19:16:23,216] INFO     processor/main       Start clean up of CrowdStrike Credential user names indicator type events from MISP.
[2023-03-31 19:16:23,360] INFO     processor/main       Start clean up of CrowdStrike Certificate serial numbers indicator type events from MISP.
[2023-03-31 19:16:23,465] INFO     processor/main       Start clean up of CrowdStrike Certificate subjects indicator type events from MISP.
[2023-03-31 19:16:23,682] INFO     processor/main       Start clean up of CrowdStrike malware family indicator events from MISP.
[2023-03-31 19:16:23,806] INFO     processor/main       Completed deletion of CrowdStrike indicators within MISP in 6.09 seconds
[2023-03-31 19:16:23,806] INFO     processor/main       Finished cleaning up CrowdStrike related events from MISP, 0 events deleted.
[2023-03-31 19:16:23,806] INFO     processor/main       BEGIN DELETE
[2023-03-31 19:16:23,807] INFO     processor/main       Retrieving list of tags to remove from MISP instance (may take several minutes).
[2023-03-31 19:16:24,194] INFO     processor/main       Finished cleaning up CrowdStrike related tags from MISP, 0 tags deleted.
[2023-03-31 19:16:24,194] INFO     misp_tools    FINISHED

I believe I may have found the Root Cause for this issue:
I'd deleted the CrowdStrike Tags as part of another set of Tag related Issues.
I suspect you may be totally relying on Tags to identify the Obliterate target list.  If so, a more resilient methodology would include criteria like Organization.  We'd still need some parameter driven tag specification.  In our case our AT&T specific Tags we apply would be used for the deletions that focus on a given category (i.e., Actors, Reports, Indicators).
Let's validate the assumption that bulk deletions are currently based solely on Tags and take it from there?

After doing a manual BulkDeletion, FullMonty, and then an Obliterate - the following artifacts remained:

Interesting.  The two events above do not have the CrowdStrike tag used to identify records for deletion.  I've seen this before, but only when I crashed / stopped import in a non-graceful manner.

If you cleared the tags, then I'm sure that's the cause.  I've tried adding in org ID to the filter used to select deleted records, and that doesn't seem to work using pymisp.  That was a couple versions back, so I can retry this in a follow up revision.
Closing this one for now, as I think we've found it.  Feel free to reopen if you find another example.


[AWS][CoreOS] - cloud formation template fails

I'm trying to use your cloudformation template for CoreOS at amazon cloud (https://github.com/GoogleCloudPlatform/kubernetes/blob/master/docs/getting-started-guides/aws/cloudformation-template.json) But i always get an error: 'Cannot create outputs: Attribute: PublicIp was not found for resource:...'
Let me know if you need more information...

cc @jmreicha


[FLINK-7098] Adapt startup scripts to start Flip-6 standalone session cluster

This PR is based on #4272, #4261, #4260 and #4259.
Adapt the start up scripts such that we can now use the jobmanager.sh script to launch a Flip-6 standalone session cluster with the command ./jobmanager.sh start flip6. Stopping the standalone session cluster entrypoint is done via ./jobmanager.sh stop flip6.
In order to start a complete Flip-6 standalone cluster, we can use the ./start-cluster.sh flip6 command. In order to stop the cluster, we have to call ./stop-cluster.sh flip6.

Thanks for the review @zentol. Will rebase this PR and if Travis gives green light, then I'll merge it.


Added parsing of images

Added parsing of images

@bizso09 Do you think this merge request has additional benefits compared to https://github.com/taspinar/twitterscraper/pull/210 ?
Otherwise I am inclined to merge PR210 and not this one. Not only was it submitted earlier but it also contains a has_video tag.


docs(auth): fix typo in function documentation of createUserWithEmailAndPassword

just a small typo I came across while checking the function documentation

Hi @JaFeKl, thanks for the fix. Kindly sign the CLA.


performance - CPU heavy requests block threads

Since we don't process each request apart from another, CPU heavy requests block the threads.
Can be solved by Accepting requests with go Ok(HandlerName)

Moving CPU heavy work to a seperated thread pool is enough. Examples will come soon

Actually after some research there is no difference between using a Thread Pool or Zap only.
I hashed a password with bcrypt which is pretty CPU intense and using a thread pool leads to 36req/s and zap only leads to 38req/s.


P3 preview

Connects to https://github.com/vaadin/components-team-tasks/issues/368

This change is

Reviewed 1 of 4 files at r2, 3 of 3 files at r4.
Review status: :shipit: complete! all files reviewed, all discussions resolved

Comments from Reviewable

Reviewed 1 of 4 files at r2, 3 of 3 files at r4.
Review status: :shipit: complete! all files reviewed, all discussions resolved

Comments from Reviewable


[WIP] Deployment Ginkgo test Run Bundle

Description of the change:
Added tests to deployments.go in run bundle
Motivation for the change:
Checklist
If the pull request includes user-facing changes, extra documentation is required:

[ ] Add a new changelog fragment in changelog/fragments (see changelog/fragments/00-template.yaml)
[ ] Add or update relevant sections of the docs website in website/content/en/docs

@Venkat19967 don't forget the license header.


Go through the whole code and make it consistent

The ReactJS branch is super stylish and formatted, and shall continue to be every time someone runs yarn format
Unsure what to do with master.


Removing applications from Conditional Access App Control apps

I don't see to have an option to remove applications from Conditional Access App Control apps? is this possible if not it should be reflected in the docs.

#please-close @msmbaldwin


[Communication] - Phone Numbers - Add specific test phone number for Python and updating capabilities tests

/azp run python - communication - tests

/azp run python - communication - tests

/azp run python - communication - tests


Update serac_tests submodule, add docs for how to rebaseline integration tests

Resolves issue described here https://github.com/LLNL/serac_tests/pull/22
Adds info on how to update integration test tolerances
Minor docs tweaks (updating compiler/ machine versions, spelling, etc)

I avoided updating the WSL Ubuntu stuff, since I haven't tested this myself, and don't know the current status of that.

docs: https://serac.readthedocs.io/en/bugfix-chapman39-single-baseline/sphinx/dev_guide/testing.html#integration-tests


injected javascript comments now work on android

Summary
When injecting a script to a WebView component via injectedJavaScript prop, if the script contains any comment then it won't work on android (issue: https://github.com/facebook/react-native/issues/9749).
Test plan
Create a WebView in which we inject a script with a simple comment in it.
Code to reproduce
import React from 'react';
import { AppRegistry, StyleSheet, Text, View, WebView } from 'react-native';

function SampleApp () {
  const html = `
    <html>
      <body>
        <h1 class="title"> Hello! </h1>
      </body>
    </html>
  `;
  const script = `
    var text = "Bye!"; // This comment will break the script on android
    document.querySelector(".title").textContent = text;
  `;
  return (
    <View style={styles.container}>
      <Text> WebView script comment issue </Text>
      <WebView
        source={{html: html}}
        injectedJavaScript={script}
        javaScriptEnabled
      />
    </View>
  );
}

const styles = StyleSheet.create({
  container: {
    flex: 1,
    justifyContent: 'center',
    alignItems: 'stretch',
    backgroundColor: '#F5FCFF',
    paddingTop: 50
  }
});

AppRegistry.registerComponent('SampleApp', () => SampleApp);

Expected Results
Text on html h1 element ("Hello!") should be replaced with "Bye!" text.
Actual Results
Text on h1 html element changes on iOS but not on Android. Removing the comment on the js script will fix this issue.

Does this means it will only work properly with comments on kitkat+?


Join Paths Are expected to form a tree - SSAS 2019 Inactive relationship and RLS

In SSAS model I have active and inactive relationship with Dim and Fact table. Measures use the inactive relationship using USERELATIONSHIP Function for Dim (Geo) and Fact which has RLS based on the Dim Table (geo).
It was working fine in certain environments and others it doesn't.

SSAS Version; <IP_ADDRESS> - Working
SSAS Version; <IP_ADDRESS> - Not Working

@Arumugaperumalc -- Arumuga, thank you for your feedback.  Are you following a particular docs.microsoft.com article?  Meanwhile, please consider these resources:

SQL Server on Microsoft Q&A
DBA Stack Exchange
Stack Overflow


Fix stage_hashstate for storage

Our code has to be different from Erigon code because we don't have its AutoDupSortKeysConversion feature.

ok, so you altered the db format for storage keys, in erigon is address hash + incarnation + key hash you made it become address hash+incarnation, so you put a load function which fixes the above but i do not see how that is different from just accessing it when we extract data, in other words what changed with what the code was before. Erigon does not seems to act like this either

one more thing, the contract we deploy in test has only one location not 2, it should just have a location 0 not a location 1

in the test you are just testing Address hash + incarnation not Address hash + incarnation + key hash

ok, so you altered the db format for storage keys, in erigon is address hash + incarnation + key hash you made it become address hash+incarnation, so you put a load function which fixes the above but i do not see how that is different from just accessing it when we extract data, in other words what changed with what the code was before. Erigon does not seems to act like this either

I haven't altered the DB format from that of Erigon. However, Erigon does special magic with MDBX_DUPSORT entries (see AutoDupSortKeysConversion), which we don't have in Silkworm. So the code in Erigon looks as if storage key were address hash + incarnation + location hash, but it's not true on the MDBX level. On the MDBX level storage key is address hash + incarnation, while storage (multi)value is location hash + zeroless value.


No break before opening braces of function definition.

int main()
{
}

gets formated to
int main() {}

This should be covered by BreakBeforeBraces: Allman but somehow it doesn't work. Tried other options here but I had no success.

Agreed, violates:

Braces, both open and close, go on their own lines (no "cuddled braces").

I think there are small bugs in clang but overall clang is very helpful. A newer version of clang might fix this, but when I tried upgrading other things changed that broke the format even more. Overall, this hasn't been a big issue for me because I try to never have empty functions.

I used this empty main because it's the smallest working sample. It cudddles my braces also for non-empty functions.

Do you know of a better tool than clang for making code obey ROS format?

This is the config I use for eclipse. Didn't verify it completely againt the style guide. (Remove the .txt postfix)
ROS.xml
Uncrustify also looks promising. It has Atom and Emacs integration.

I just fixed this bug: https://github.com/davetcoleman/roscpp_code_format/commit/9ae3e9c9d68e45583b1f140c46ea7543cf08a32e
I think I'll stick to clang-format, its used widely as well.


Irritating Issue: Problem Tab shows up att the time while Hovering even when it is minimized

Version: 1.36.1
Commit: 2213894ea0415ee8c85c5eea0d0ff81ecc191529
Date: 2019-07-08T22:55:08.091Z
Electron: 4.2.5
Chrome: 69.0.3497.128
Node.js: 10.11.0
V8: 6.9.427.31-electron.0
OS: Linux x64 5.0.0-21-generic

As shown in the following image I can close the problem tab pane by clicking on the X symbol at the end. When the extension is enabled, it opens the pane, whenever I hover on any part of the code, which is a bit annoying as, not all the time we want the pane to be open.
If somebody wants it, they could manually open the pane and hover on the code.

Issue moved to: Irritating Issue: Problem Tab shows up att the time while Hovering even when it is minimized · Issue #140 · mads-hartmann/bash-language-server


Improvement: Backend Improvements for Typing, Tests, Modularity and Pathlib

added all the functionality you can check it
Typing: Add type hints throughout the backend
Unit Tests: Develop unit tests for all utility and processing functions.
Response Handling: Add a ResponseHandler class in backend/response_handler.py to handle all communication bwn BE-FE, BE-core using consistent JSON responses.
Replace os with pathlib
Reorganize the code under backend/:
Move Utils to backend/utils.py
Move MediaHandler to backend/media_handler.py
Keep app.py for route definitions and Flask app initialization.

Thanks for your second PR to this project, but unfortunately, it does not meet the project requirements. The current code is not functional, and there are commits outside the scope of this PR. Additionally, the unit tests were either minimal or not tests at all, but rather the class itself.
Thank you for your understanding, and I hope to see improved contributions in the future.


Alluxio replicates the block repeatedly without committing it

Alluxio Version:
2.7.1
Describe the bug
Alluxio replicates the block repeatedly without committing it
To Reproduce

The file has 1 existing replica

$ ./bin/alluxio fs location /projects/test/test_dir/file.1
/projects/test/test_dir/file.1 with file id<PHONE_NUMBER>87 is on nodes:
dev01-xx

Set replicationMin to 2 and pin the file

$ ./bin/alluxio fs setReplication --min 2 /projects/test/test_dir/file.1
$ ./bin/alluxio fs pin /projects/test/test_dir/file.1

Alluxio replicates the file repeatedly without committing it

2022-07-19 15:55:56,690 INFO  task.TaskExecutorManager (TaskExecutorManager.java:executeTask) - Task 0 for job<PHONE_NUMBER>371 received
2022-07-19 15:55:56,690 INFO  task.TaskExecutorManager (TaskExecutorManager.java:notifyTaskRunning) - Task 0 for job<PHONE_NUMBER>371 started
2022-07-19 15:55:56,741 INFO  replicate.ReplicateDefinition (ReplicateDefinition.java:runTask) - Replicated file /projects/test/test_dir/file.1 block<PHONE_NUMBER>72
2022-07-19 15:55:56,742 INFO  task.TaskExecutorManager (TaskExecutorManager.java:notifyTaskCompletion) - Task 0 for job<PHONE_NUMBER>371 completed.
2022-07-19 15:56:56,692 INFO  command.CommandHandlingExecutor (CommandHandlingExecutor.java:run) - Received run task 0 for job<PHONE_NUMBER>372 on worker<PHONE_NUMBER>069
2022-07-19 15:56:56,692 INFO  task.TaskExecutorManager (TaskExecutorManager.java:executeTask) - Task 0 for job<PHONE_NUMBER>372 received
2022-07-19 15:56:56,693 INFO  task.TaskExecutorManager (TaskExecutorManager.java:notifyTaskRunning) - Task 0 for job<PHONE_NUMBER>372 started
2022-07-19 15:56:56,763 INFO  replicate.ReplicateDefinition (ReplicateDefinition.java:runTask) - Replicated file /projects/test/test_dir/file.1 block<PHONE_NUMBER>72
2022-07-19 15:56:56,763 INFO  task.TaskExecutorManager (TaskExecutorManager.java:notifyTaskCompletion) - Task 0 for job<PHONE_NUMBER>372 completed.

Expected behavior
Commit the block and do not replicate it repeatedly.
Urgency
High
Are you planning to fix it
Yes

The cause is this PR: #13146.
It removed BlockOutStream which calls DataWriter, while BlockWorkerDataWriter#close calls DefaultBlockWorker#commitBlock.

AlluxioFileInStream supports passive cache and calls DefaultBlockWorker#cache for each block, but BlockInStream itself does not support passive cache.

@jja725 could you take a look please?

thanks for raising the issue and I would take a look at this.

are you planning on fixing it?

Yes, my idea is to make BlockInStream support passive cache.
Do you have any suggestions? @jja725

@secfree Hi, thanks for the invesitigation. I feel like we are taking a detour here to use passive cache to load data. The easiest way I think is to commit the block after writing the data. Otherwise, we need to take care of the passive cache in both AlluxioFileInStream and BlockInStream which may cause some problems.

@jja725 thanks for your reply.

The easiest way I think is to commit the block after writing the data.
If BlockOutStream is created, it will commit block automatically. But #13146 already removed BlockOutStream.

Otherwise, we need to take care of the passive cache in both AlluxioFileInStream and BlockInStream which may cause some problems.
Can you check my PR(#15918)? It moved passive cache logic from AlluxioFileInStream to BlockInStream.

@secfree I think when the file is pinned, it would go through the code 161 to 193 in the JobUtils.java. So we are actually using inStream and BlockOutStream to load the file into his specific location.
Yeah I agree move passive cache to BlockInStream  would solve this problem, but it would a read operation and it's not efficient

I think when the file is pinned, it would go through the code 161 to 193 in the JobUtils.java.

Have you tested it? In my test case mentioned above, it went to this branch https://github.com/Alluxio/alluxio/blob/master/job/server/src/main/java/alluxio/job/util/JobUtils.java#L154

Another idea is disabling passive cache for pinned files. It also resolves the issue. Here is the PR: #15946 .
@jja725 what do you think about this? Thank you.

@jja725 any thoughts on the PR?

@secfree  I leave a slack message to you and want to record it here as well.
I tested it again on my local machine and It works fine with the most updated version(1 worker with 1 replication). So want to double check your env. If you only have one worker and want to have two replicas, which is not allowed by the worker.

@jja725 I tested with two workers, and confirmed that the replication task was received by the job_worker in the second worker. The log is also from the second worker
2022-07-19 15:55:56,690 INFO  task.TaskExecutorManager (TaskExecutorManager.java:executeTask) - Task 0 for job<PHONE_NUMBER>371 received
2022-07-19 15:55:56,690 INFO  task.TaskExecutorManager (TaskExecutorManager.java:notifyTaskRunning) - Task 0 for job<PHONE_NUMBER>371 started
2022-07-19 15:55:56,741 INFO  replicate.ReplicateDefinition (ReplicateDefinition.java:runTask) - Replicated file /projects/test/test_dir/file.1 block<PHONE_NUMBER>72
2022-07-19 15:55:56,742 INFO  task.TaskExecutorManager (TaskExecutorManager.java:notifyTaskCompletion) - Task 0 for job<PHONE_NUMBER>371 completed.
...
2022-07-19 15:56:56,763 INFO  replicate.ReplicateDefinition (ReplicateDefinition.java:runTask) - Replicated file /projects/test/test_dir/file.1 block<PHONE_NUMBER>72
2022-07-19 15:56:56,763 INFO  task.TaskExecutorManager (TaskExecutorManager.java:notifyTaskCompletion) - Task 0 for job<PHONE_NUMBER>372 completed.

sorry for the delay, when I tried to reproduce the problem I noticed that the block actually gets committed in one worker but can't get committed in the other workers which I think neither of the fixes explains the problem. I think I need more time figuring out the bug but I feel OK with disabling passive cache solution for now since it indeed resolves the problem.

@jja725 thanks for your checking.
In my test case, he first replica of the block in alluxio was wrote by client directly. So it does not involve "passive cache". setReplication copies the block from the first worker to a new one, that is where passive cache takes effect.

Thanks for digging into the issue and help me understand the problem.
@yuzhu I think this also tells why distributedLoad with replications doesn't work very well(https://github.com/Alluxio/alluxio/issues/14274) because it doesn't commit the block when reading from the remote worker. We should add back the commit call when reading from the remote worker.


OpenWRT compatibility

OpenWRT is a fairly popular OS for homelabs. It would be pretty nice if Gatekeeper could be easily installed & executed there (say as a OpenWRT package).

Some work on this front already was submitted and I've managed to get Gatekeeper working on an OpenWRT-based RaspberryPI 3B access point. Unfortunately some manual commands were necessary to get it working. Ideally they should all be automated.
I'll list them here to avoid forgetting:

Before startup (during installation) ensure that PACKAGE_kmod-nft-queue is present.
On startup disable any DNS & DHCP providers (in my case it was dnsmasq & odhcpd but any other DNS/DHCP provider would also potentially create a conflict).
On startup fetch LAN & WAN interface names from the OpenWRT UCI system.
Test whether it runs ok on MIPS.

Once that's done a Gatekeeper package can be submitted to https://github.com/openwrt/packages


Allow the Choice of IP/Name of the NIC to be used on servers with multiple NICs on all commands

Is this a feature OR bug:
https://trello.com/c/gHVT1meS
Additional comments
This could be using some GUI to select the one we want, or an extra variable that accepts the suffix of the network card.
Since I have this problem, I believe that someone else can also have it
Example: Server srv1 has 3 IPs

IP1
IP2
IP3

From my PC when I ping the srv1 the IP I see is IP1 but I'm only able to connect to sql server instance through IP2 so if I PING srv1.IP2 I can see the IP of IP2.
Once Resolve-NetBiosName only retrieves the server name this will be the IP1 and not the IP2 that I need.
This should be added to all $sourcenetbios variables.
Thoughts?

I believe this is impossible - just pass the IP eh? Not respecting the passed servername should be fixed in another ticket where we stop using ComputerNetBios and start using $instance.ComputerName


operator/configuration: pin the image-tag

Expected Behavior
Hi,
in the configuration of operator, we can override the following default value for the image specs:

registry
imagePath
imagePrefix
imagePullSecrets

It would be nice to be able to override imageTag, it can also been considered as a good practice to pin image tag in order to ensure reliability.
Current Behavior
I guess it has historical reason, but if we check images pulled by the operator:

calico/typha
calico/pod2daemon-flexvol
calico/cni
calico/node
calico/kube-controllers

They both target the same tag.
Looking at the code, there is this:
	if is == nil {
		return fmt.Sprintf("%s%s:%s", registry, image, c.Version), nil
	}

	for _, img := range is.Spec.Images {
		if img.Image == c.Image {
			return fmt.Sprintf("%s%s@%s", registry, image, img.Digest), nil
		}
	}

Which use the c.Version (hardcoded to master) or img.Digest.
Possible Solution
Provide a imageTag field into spec and use it in case it's provided.
Context
Calico is used in Flatcar automated CI and we noticed that we were always pulling a "latest" version because we're mirroring image from Docker Hub to GHCR.

@tmjd WDYT?

We don't want to expose using arbitrary image tags, as each operator release is intended for use with only one version of Calico - trying to use any other version "voids the warranty", so to speak.
You can, however, already specify images by their precise digest if you like: https://projectcalico.docs.tigera.io/reference/installation/api#operator.tigera.io/v1.ImageSetSpec
Just make sure you're using the correct version of Calico for the given operator.


Warning: Most used rule is not a morpheme": __

You know what causes this error?

eg: Comes with bin/sample2.js

I don't know, I didn't continue working on this project. Instead, I was working on this other project:
https://github.com/luisvt/js2dart


Idea?

I've noticed whenever I open the program it makes a new folder in \AppData\Local\Temp and it kinda gets annoying is there a way to make all the code go in the folder the .exe was opened in?

Its a temp folder for a reason why is it annoying

No, the exe was compiled using one-file mode, meaning it needs to make a separate directory to extract the code into.

No, the exe was compiled using one-file mode, meaning it needs to make a separate directory to extract the code into. A fix would be to compile it in one-dir mode but then the folder you downloaded the executable into will have 100s of files (DLLs, code, etc), making it harder to find the actual executable when you want to run it.

^^

Also the project is open source so you can edit the code and recompile it so that it goes to another directory, such as ~/dankcache or something.

Also the project is open source so you can edit the code and recompile it so that it goes to another directory, such as ~/dankcache or something.

No you can't, as the directory is not linked to the program. It is linked to the compiler used, which is PyInstaller, and so you would have to find a way to tell PyInstaller to use a different directory.


Update git-trim

Noticed a minor typo in the description for the new dry-run option

@Hodglim thanks!

@Hodglim you are welcome bud.


Guidance for an aarch64 sony kitikami platform kernel source ?

pelya,
hi, the issue during compile is this;
drivers/built-in.o: In function `hid_function_cleanup':
/storage/sxZ5_dev/kernel/wafflez/drivers/usb/gadget/android.c:2979: undefined reference to `ghid_cleanup'
/storage/sxZ5_dev/kernel/wafflez/drivers/usb/gadget/android.c:2979:(.text+0x369dfc): relocation truncated to fit: R_AARCH64_CALL26 against undefined symbol `ghid_cleanup'
drivers/built-in.o: In function `hid_function_init':
/storage/sxZ5_dev/kernel/wafflez/drivers/usb/gadget/android.c:2974: undefined reference to `ghid_setup'
/storage/sxZ5_dev/kernel/wafflez/drivers/usb/gadget/android.c:2974:(.text+0x369e18): relocation truncated to fit: R_AARCH64_CALL26 against undefined symbol `ghid_setup'
drivers/built-in.o: In function `hid_function_bind_config':
/storage/sxZ5_dev/kernel/wafflez/drivers/usb/gadget/android.c:2986: undefined reference to `hidg_bind_config'
/storage/sxZ5_dev/kernel/wafflez/drivers/usb/gadget/android.c:2986:(.text+0x372d9c): relocation truncated to fit: R_AARCH64_CALL26 against undefined symbol `hidg_bind_config'
/storage/sxZ5_dev/kernel/wafflez/drivers/usb/gadget/android.c:2992: undefined reference to `hidg_bind_config'
/storage/sxZ5_dev/kernel/wafflez/drivers/usb/gadget/android.c:2992:(.text+0x372dc0): relocation truncated to fit: R_AARCH64_CALL26 against undefined symbol `hidg_bind_config'
Makefile:801: recipe for target 'vmlinux' failed

I am working with sony kitikami platform kernel source
VERSION = 3
PATCHLEVEL = 10
SUBLEVEL = 49
EXTRAVERSION =
NAME = TOSSUG Baby Fish
toolchain: aarch64-linux-android-4.9-kernel/bin/aarch64-linux-android-
I started from your kernel-3.10-nexus9.patch, as it seemed the closest starting point.
I am a little lost and still new to aarch64. Help !! =D
Thanks.
m

pelya,
hi again, UPDATE, the patch kernel-3.10-nexus6.patch
appears to do for the Sony Xperia Z5 kernel source at the moment,
I am running another build from zero just to see if i have it right.
thanks
m

I never tried my patch with 64-bit kernel, so you are on your own here.
Does this kernel work?
On Feb 23, 2016 8:30 AM, "moon butt74"<EMAIL_ADDRESS>wrote:

pelya,
hi again, UPDATE, the patch kernel-3.10-nexus6.patch
appears to do for the Sony Xperia Z5 kernel source at the moment,
I am running another build from zero just to see if i have it right.
thanks
m
—
Reply to this email directly or view it on GitHub
https://github.com/pelya/android-keyboard-gadget/issues/46#issuecomment-187567376
.

Yeah it seems to but getting the patching procedure correct is proving a little diffcult. =/
My second build porked it with mssing files , so i git reset --hard and am going again.

pelya,
okay, build 4 and i can confirm kernel-3.10-nexus6.patch working with the aforementioned kernel source and toolchain, although i haven't tried any of the kali toys yet, the basic functionality of your app is go, mouse,keyboard. It doesn't appear to be aarch64 related at all, I just used the wrong patch at the beginning. This device uses the /dev/block/bootdevice/by-name/  setup which is REALLY annoying. =p. One final question, I am LOUSY with creating patches correctly, do i need to create one or will you just add a note to the existing one?
Thanks again.
m

Ideally I would like a compiled boot.img compatible with some version of
Android (Kali is nice and all, but still cannot do voice calls).
Patch is not so important for me, I already got five of them in the repo,
doing the same thing, and I can only test one.
On Feb 23, 2016 8:59 AM, "moon butt74"<EMAIL_ADDRESS>wrote:

pelya,
okay, build 4 and i can confirm kernel-3.10-nexus6.patch working with the
aforementioned kernel source and toolchain, although i haven't tried any of
the kali toys yet, the basic functionality of your app is go,
mouse,keyboard. It doesn't appear to be aarch64 related at all, I just used
the wrong patch at the beginning. This device uses the
/dev/block/bootdevice/by-name/ setup which is REALLY annoying. =p. One
final question, I am LOUSY with creating patches correctly, do i need to
create one or will you just add a note to the existing one?
Thanks again.
m
—
Reply to this email directly or view it on GitHub
https://github.com/pelya/android-keyboard-gadget/issues/46#issuecomment-187575643
.

pelya,
Okay cool,
Sony_XperiaZ5p_HID_E6853_boot.img
https://www.androidfilehost.com/?fid=24421527759886007
Android version 5.1.1 SELinux permissive
Linux kali 3.10.49-bandersnatch_sxZ5_P_HID #1 SMP PREEMPT Tue Feb 23 02:54:49 EST 2016 aarch64 GNU/Linux
m

I've put it into the repository, thanks.
On Tue, Feb 23, 2016 at 9:28 PM, moon butt74<EMAIL_ADDRESS>wrote:

Closed #46 https://github.com/pelya/android-keyboard-gadget/issues/46.
—
Reply to this email directly or view it on GitHub
https://github.com/pelya/android-keyboard-gadget/issues/46#event-562219147
.

Hi ghost/Moonbutt47.
I am attempting to port this over to the stock Sony Kitakami Z5C kernel, as part of a wider NetHunter port. As you have done this for the Z5P I would be interested in looking at your work. I keep getting a persistent error while compiling. As you have changed your github account since this issue was closed Im leaving this comment here to see if I can locate you.
build env : Ubuntu 16.04
T/C GCC aarch64-linux-android-4.9
error: Makefile:798: *** multiple target patterns.  Stop.
which refers to script:   scripts/link-vmlinux.sh refereed to as $(vmlinux-deps)... I would love to look at your source code if it has been uploaded.
Regards
Joeisgood99.


Update @types/node

There was a compatibility issue with TypeScript 4.9 Beta in @types/node that was fixed in a recent version. This unblocks TypeScript Playground builds of the beta. Thanks!

CI failure looks unrelated. Known flaky?


bump posthog-js

We are seeing data being sent to the postgres database but not posthog, wanted to test this on staging.

This doesn't need to be approved as you're just using the development branch yes?

This doesn't need to be approved as you're just using the development branch yes?

Correct, I'm just trying to debug why I'm not getting any Posthog data.

Version 1.43.0

Bumped to 1.88.1 and still works against our 1.43.0 Cluster.

Generally, we don't include submodule updates in PRs. Is there a particular reason they are included here?

For some reason, my setup auto-updates it on each yarn install.


As of the latest version, Ctrl+Backspace deletes a word backwards and Ctrl+Delete deletes a word forward, although it's bugged such that it doesn't work if the cursor is on the last word. (That might be an issue with RSyntaxTextArea itself).

confirmed, closing


[BUG] well my bloxstrap just randomly says "install" when i already have did in the past and i dont know why this happens. ANDD, it gives me a error for trying to install it

Acknowledgement of preliminary instructions

[X] I have read the preliminary instructions, and I am certain that my problem has not already been addressed.
[X] I have thoroughly looked through the available Wiki articles and could not find a solution to my problem.
[X] I am using the latest version of Bloxstrap.
[X] I did not answer truthfully to all the above checkboxes.

Bloxstrap Version
v2.5.4
What problem did you encounter?
https://github.com/user-attachments/assets/95d26e19-7e71-4862-b7a0-2a573eb7a092
Bloxstrap Log
N/A

... update to the latest version... WHERE DID YALL GET BLOXSTRAP FROM?

Probably off youtube videos, a lot of old ones still have it iirc

gotta love when he tick "I did not answer truthfully to all the above checkboxes."

I like the ones that have that and they are on the newest version


Cancel 25 March Meeting?

Hi folks, a few of us are unavailable this Thursday.  I propose we cancel the meeting this week and pick back up on 1 April.

Sounds good. Thanks, Steve. Catch you all next week.

I'll hang out for 5-10 minutes to let folks know and perhaps gather agenda items for next week.  Take care.


N7100 (Note II) listed as "Gadget Serial" insted of "Samsung Composite Device"

This has nothing to do with Heimdall itself, but I think it would help a lot of people with their confusion when using Heimdall for the N7100 if you added this to the instructions/readme. When in download mode, windows lists the device as "Gadget Serial" instead of "Samsung Composite USB Device".
I dont know if this happens on all Note II devices though.
Also, there's a small typo on line 41 of the Windows README :laughing:

it does not happen on the sprint note 2 or 4

on  I9300  it  list as  "MSM8960"

Yeah, unfortunately the devices say all sorts of garbage.
I'm closing this as there's not a "one size fits all" solution that I'm aware of.


remove pwd to .env

dont put passwords out there like that : /

Ah, I forgot to change this. Many thanks.


Eevee texture

Server atlas
Ign: Quadehar97
The other day I caught a eevee with the creator texture (team rocket outfit) but on the server it shows up as broken with purple and black squares. Just tested it in single player to make sure its not a mod issue and it works there (Sorry bad pics but best I can do)

Just wondering if this has been looked at since

Hi there!  Thanks for your report!
An error has been fixed with the texture/model in our datapack for the next version :)


feat: 更改codecov-action@v1

Codecov Report

Merging #14 into master will decrease coverage by 19.60%.
The diff coverage is n/a.

@@             Coverage Diff              @@
##            master      #14       +/-   ##
============================================
- Coverage   100.00%   80.39%   -19.61%
============================================
  Files            3        3
  Lines           51       51
  Branches        10       10
============================================
- Hits            51       41       -10
- Partials         0       10       +10

Flag
Coverage Δ

#unittests
80.39% <ø> (?)

Impacted Files
Coverage Δ

src/addQueryToUrl.ts
73.91% <0.00%> (-26.09%)
:arrow_down:

src/getUrlQuery.ts
76.47% <0.00%> (-23.53%)
:arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7d1088e...c530086. Read the comment docs.


Quickstart guide?

Is there a quickstart guide to test basic functionality?  Here's mine, which isn't working as expected:
apt install -y dnsutils

EXAMPLEIP=$(dig +short example.com)

cat > /etc/xdpfw/xdpfw.conf <<EOF
interface = "eth0";
updatetime = 15;
filters = (
    {
        enabled = true,
        dstip = "${EXAMPLEIP}",
        action = 0
    }
);
EOF

service xdpfw restart

curl -s -L -m 5 http://example.com | grep -q illustrative && echo FAIL || echo PASS

FAIL

I don't have any quickstart guide written at the moment, but I can make one when I have the time. What is your goal with the above config? Are you trying to allow traffic to $EXAMPLEIP?

No, I'm trying to block example.com (as a test case)

P.S. I noticed your config filters section uses parenthesis "( ... )" which I thought was odd syntax and then I noticed https://github.com/Barricade-FW/Firewall uses the more familiar "[ ... ]" array syntax.  Can I use "[ ... ]" in XDP-Firewall?

The reason the above config isn't working is because you need to specify a protocol at the moment. So since the above is HTTP traffic (TCP), you can do something like this:
interface = "eth0";
updatetime = 15;
filters = (
    {
        enabled = true,
        dstip = "${EXAMPLEIP}",
        action = 0,

        tcpopts = (
            {
                    enabled = true
            }
        )
    }
);

I just tested this on my own website on a VM I have with the following and it worked:
interface = "ens18";
updatetime = 15;

filters = (
    {
        enabled = true,
        action = 0,
        dstip = "<IP_ADDRESS>",

        tcpopts = (
                {
                        enabled = true
                }
        )
    }
);

I'd imagine you'd prefer an option where you don't have to specify the protocol (especially for filters where you only want to block IPs). Therefore, I will be looking into implementing this shortly (I'll make it so the config you posted above works as expected).
As for the filters syntax in the config file, I understand it's a bit confusing right now with the protocol options. Unfortunately, it doesn't support [] at the moment since we're using the LibConfig library to parse the config. I've cleaned up the syntax in my Barricade Firewall and also started using JSON.

I've pushed a commit to the project that should allow layer 3-only filtering. Therefore, your initial config should work properly after pulling the latest changes. I've tested this on a vanilla Ubuntu VM (20.04) as well and it was working fine for me. I also made sure protocol-specific filtering was still working.

Awesome, thanks!  I'm switching over to your Barricade Firewall for the performance gains so if you could enable that feature there as well that would be great.


Custom admnitions

Add custom admonitions:

podcast
newsletter
company
contribute
book

Adjust question background color

@sbasken I'm don't see this work when testing.
take a look at the /component-library


chat_login scope is depreciated for new clients

See https://dev.twitch.tv/docs/authentication/#twitch-api-v5

Thanks!!


OSM basemap blurry

Wegue
osm.org

The OSM basemap looks more blurry on Wegue compared to the OpenStreetMap website

the bug does not exist anymore


Add help in Spell Selection Dialog

I propose to add opening help page on right click in Spell Selection Dialog (when memorizing and during level up), which should open spell help entry.

Well there's the "press H for help mode" toggle. Is that too obscure?
On a related note, I thought you might be referring to character creation, because apparently the help box is bugged there (in Temple+).

I will provide more requirements shortly.

I didn't know H did that, at least. I guess that's probably in the manual I didn't read 20 years ago? :)

My wish would concern only Context Menu spells now - let's make right click to behave as Help mode is active.
Or make middle click to behave as Help mode is active.
Right click is common help in IWD2 and KotC.
Also I can confirm Help mode works fine in Creation Dialog, Inventory Dialog and Context Menu.

But right click is used to choose spells, so why should it be changed to open spells? Unless I'm missing something...
Also what are "context menu spells"?

But right click is used to choose spells, so why should it be changed to open spells? Unless I'm missing something...
Yes, true. That's why I do not see this option viable anymore (changed my mind) in dialogs.

But in context menu (see the pic) there is no way to see the Help.

Oh, that's called the radial menu.
Well for that you can also press H, but I agree that right click can also do the same. Although, currently it does closes the radial menu, no?

Although, currently it does closes the radial menu, no?

It does nothing. Radial menu remains open. Right click is ignored.


Problems while deploying to Google App Engine

Hi guys,
I am trying to deploy a simple graphpack project to GAE, but can't get GAE to resolve dependencies like "apollo-server" properly
I have this in my package.json:
  "scripts": {
    "dev": "graphpack",
    "build": "graphpack build",
    "start": "node ./build/index.js"
  },
  "dependencies": {
    "graphpack": "^1.0.0-alpha.3"
  }

GAE is running npm start to start-up the deployed app and it fails saying this:
Cannot find module 'apollo-server'

It is supposed to resolve dependencies using package.json (I am not uploading node_modules). But for some reason having "graphpack" in dependecies doesn't make it resolve "apollo-server" 😕
Do I have to run graphpack build on the server before running npm start to make it resolve dependencies correctly? And in this case is there a way to run graphpack build with npm?

The error was caused by the yarn.lock file - ignoring it for deployment fixed it


Add temporary Rake task to update unpublished specialist document paths

A large number of SpecialistDocuments were urgently unpublished before redirects were created.
This PR adds a temporary Rake task to add the redirect, after running it can be reverted.

Replaced by https://github.com/alphagov/specialist-publisher/pull/1580


Add tests for example scripts + nits

Write tests for example scripts
What does this add?
Since the DataLoaders are seperated out to a function in the by_feature tests, we can write out tests for all of the examples to essentially prove if they run all the way through, and if they output the data we're interested in.
These are slightly different than the transformers examples tests, as with the defaults currently set in the example scripts performance is quite low (can be fixed by reducing the learning rate and starting steps, but I think that's redundant since then we're aiming for them to be tailored to the test, not the example)
Why is it needed?
Redundancies to let us know if any of these examples break. If they do, then that means we also should probably update one of the other examples.

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

I've come up with a solution to make sure that also the main complete_ examples will raise an error if they differ from the bits inside of by_feature. Now eventually it would be good to have an exclusion list of files for when we wouldn't expect to see some feature added (such as say cross validation). But we'll cross that bridge when we get there. In the meantime here is the report generated back to the user from pytest:
(Note: pytest-subtests was added as a dep to make sure we could use TestCase.subTest and make this code clean and efficient)
======================================================================= short test summary info =======================================================================
SUBFAIL tests/test_examples.py::ExampleDifferenceTests::test_complete_cv_example_body - AssertionError: 14 != 0
SUBFAIL tests/test_examples.py::ExampleDifferenceTests::test_complete_cv_example_body - AssertionError: 27 != 0
SUBFAIL tests/test_examples.py::ExampleDifferenceTests::test_complete_cv_example_parser - AssertionError: 1 != 0
SUBFAIL tests/test_examples.py::ExampleDifferenceTests::test_complete_cv_example_parser - AssertionError: 4 != 0
SUBFAIL tests/test_examples.py::ExampleDifferenceTests::test_complete_nlp_example_parser - AssertionError: 1 != 0
SUBFAIL tests/test_examples.py::ExampleDifferenceTests::test_complete_nlp_example_parser - AssertionError: 1 != 0
=============================================================== 6 failed, 4 passed, 1 warning in 1.64s ================================================================

Slightly tweaked how they look, I've now included it posting the source code diffs. I believe this is a must as it will tell the user exactly what parts were missing from the full example:
============================================================================== FAILURES ===============================================================================
_________ ExampleDifferenceTests.test_cv_example (feature_script='tracking.py', tested_script='complete_cv_example.py', tested_section='training_function()') _________

self = <test_examples.ExampleDifferenceTests testMethod=test_cv_example>, complete_file_name = 'complete_cv_example.py', parser_only = False

    def one_complete_example(self, complete_file_name: str, parser_only: bool):
        """
        Tests a single `complete` example against all of the implemented `by_feature` scripts

        Args:
            complete_file_name (`str`):
                The filename of a complete example
            parser_only (`bool`):
                Whether to look at the main training function, or the argument parser
        """
        self.maxDiff = None
        by_feature_path = os.path.abspath(os.path.join("examples", "by_feature"))
        examples_path = os.path.abspath("examples")
        for item in os.listdir(by_feature_path):
            item_path = os.path.join(by_feature_path, item)
            if os.path.isfile(item_path) and ".py" in item_path:
                with self.subTest(tested_script=complete_file_name, feature_script=item, tested_section="main()" if parser_only else "training_function()"):
                    diff = compare_against_test(
                        os.path.join(examples_path, "nlp_example.py"),
                        os.path.join(examples_path, complete_file_name),
                        item_path,
                        parser_only
                    )
>                   self.assertEqual('\n'.join(diff), '')
E                   AssertionError: '        accelerator = Accelerator(cpu=arg[693 chars]()\n' != ''
E                   -         accelerator = Accelerator(cpu=args.cpu, mixed_precision=args.mixed_precision, log_with="all")
E                   -
E                   -         accelerator = Accelerator(cpu=args.cpu, mixed_precision=args.mixed_precision)
E                   -
E                   -         accelerator.init_trackers("nlp_example", config)
E                   -
E                   -             predictions, references = accelerator.gather((predictions, batch["labels"]))
E                   -
E                   -                 predictions=predictions,
E                   -
E                   -                 references=references,
E                   -
E                   -             accelerator.log(
E                   -
E                   -                 {
E                   -
E                   -                     "accuracy": eval_metric["accuracy"],
E                   -
E                   -                     "f1": eval_metric["f1"],
E                   -
E                   -                     "train_loss": total_loss,
E                   -
E                   -                     "epoch": epoch,
E                   -
E                   -                 }
E                   -
E                   -         accelerator.end_training()

tests/test_examples.py:107: AssertionError


Improvements to the "Research" page

Research Page: https://web3privacy.info/research/
It would be worth adding to every research item at least:

image
date
description

Needs input from @Msiusko

Now we have GitHub projects where is all individual researches tracked, so we can use this as data source.

I worked on it a bit, so the Research page on the website is now automatically synchronized with the Research GH Project. Its 100% controlled by this project.

every research have own number (of Issue) - for references
title of issue = name of research
labels on issue = labels on website (for example DB - its up to you how you use it)
there is 4 categories (delivered, upcoming, backlog, deprecated) - you can control it by put issue in specific column
assignees on Issue = authors showed on website
additional properties in "front-matter" - first part of issue description (there is "caption" as short description, "description" as long description, "link" as link to research and "docs" as link to documentation)

Updates in GH project will show on website within 1-8 hours (its not realtime).
Full process is that GitHub Project is synchronized every 1 hour with data repository (https://github.com/web3privacy/data) and then every 4 hours synchronized on website.


static linking in windows

Problem
I'm trying to static link ffmpeg with the library ffmpeg-next on windows using pre build native libraries
And even though I enable static linking it doesn't link them staticlly (I suspect that it doesn't select the right .lib files.
thewh1teagle/ffmpeg-next-msvc-static
Steps

clone

git clone https://github.com/thewh1teagle/ffmpeg-msys2-static

build (I use ps1 to download pre built ffmpeg)

./build.ps1

Possible Solution(s)
When I remove the shared libraries from the pre build ffmpeg and keep only the lib* files then it doesn't find anything,
but if I change them then and rename to be without prefix of lib then it finds
But then it yields many errors of unresolved references
Notes
It may not related to cargo. checking anyway.
Version
cargo 1.75.0 (1d8b05cdd 2023-11-20)
release: 1.75.0
commit-hash: 1d8b05cdd1287c64467306cf3ca2c8ac60c11eb0
commit-date: 2023-11-20
host: x86_64-pc-windows-msvc
libgit2: 1.7.1 (sys:0.18.1 vendored)
libcurl: 8.4.0-DEV (sys:0.4.68+curl-8.4.0 vendored ssl:Schannel)
os: Windows 10.0.22631 (Windows 11 Professional) [64-bit]

It might depend on how static works in build.rs in ffmepg-sys-next.
https://github.com/zmwangx/rust-ffmpeg-sys/blob/86e6da66e2c988643043de8ca10da5af85032ca0/build.rs#L685-L691
Saw you create an issue https://github.com/zmwangx/rust-ffmpeg-sys/issues/68, so close in favor of that.
If it later turns out to be identified as a Cargo issue, free feel to create a new one.


add upload report api

Status
Ready
Related Issues
fixes: link to the issue
Description
Add upload report api call
Must have

[ ] Unit Test or Example Code
[ ] Changelog entry

@sabaghadar please update the CHANGELOG: https://github.com/demisto/demisto-py/blob/master/CHANGELOG.md


Should sort only dependencies

Sorry, I did a fatal mistake in the previous PR. It fails on the first string property, because it is passed to sort-keys. Also it sorts not only properties with dependencies.

No worries. I missed it too.


feat: add file.size

1. Does this PR affect any open issues?(Y/N) and add issue references (e.g. "fix #123", "re #123".):

[ ] N
[x] Y
Fixes #1267

2. What is the scope of this PR (e.g. component or file name):
kcl-lang/kcl/kclvm

3. Provide a description of the PR(e.g. more details, effects, motivations or doc link):

[x] Affects user behaviors
[ ] Contains syntax changes
[ ] Contains variable changes
[ ] Contains experimental features
[ ] Performance regression: Consumes more CPU
[ ] Performance regression: Consumes more Memory
[ ] Other

4. Are there any breaking changes?(Y/N) and describe the breaking changes(e.g. more details, motivations or doc link):

[x] N
[ ] Y

5. Are there test cases for these changes?(Y/N) select and add more details, references or doc links:

[ ] Unit test
[ ] Integration test
[ ] Benchmark (add benchmark stats below)
[ ] Manual test (add detailed scripts or steps below)
[ ] Other

I would like to know are the .snap files are autogenerated or am I missing anything. Please guide

Hello @JeevaRamanathan Thanks for the contribution. You can ref here to update tests. https://github.com/kcl-lang/kcl/pull/1277

I have read the CLA Document and I hereby sign the CLA

recheck

Hi @Peefy I have updated the tests and added stdout.golden, Could you please review


bug: no module named dns_providers

Which version of python are you using?
2
What operating system and version of operating system are you uing?
ubuntu
What version of sewer are you using?
0.1.1
What did you do? (be as detailed as you can)
tried to import sewer
What did you expect to see/happen/not happen?
sewer to be imported
What did you actually see/happen?
File "/vagrant/apps/common_app/tasks.py", line 10, in <module>
    import sewer
  File "/usr/local/lib/python2.7/dist-packages/sewer/__init__.py", line 2, in <module>
    from dns_providers import CloudFlareDns  # noqa: F401
ImportError: No module named dns_providers

closed by: https://github.com/komuW/sewer/pull/11


Update code checks to use clang-format-14

The old clang-format-13 formats code like this:
[[nodiscard]] auto WaitForOneOfSignals(int(&&signums)[N]) {

clang-format-14 formats the same code like this:
[[nodiscard]] auto WaitForOneOfSignals(int (&&signums)[N]) {

This causes our code-check-style action to fail.

Where are we using clang-format-14?
If/when we switch clang-format versions, we should do so everywhere (which I think just means also updating our GitHub codespaces for the respect repo: https://github.com/reboot-dev/respect/blob/411a39d3ce38f4222e5f3ce88896331dce6cd8fc/.devcontainer/Dockerfile#L59 )

Where are we using clang-format-14?

I locally use clang-format-14 since I'm using LLVM 14.


Continued backporting, removed all instance references to GlStateManager

LGTM outside some formatting but I can handle that, thanks again!


Possible to add /sec option to StatsUITweaks?

Can the /sec option be added to the production panel with StatsUITweaks? Really missing that option since the last game update and Bottleneck mod being deprecated.

Add in StatsUITweaks v1.6.1 for production/consumption rate


Zipped and unzipped deployment adding upto more than 500Mb and failing deployment

Using "slim_handler": true, the zipped version of my deployment is 120Mb and the unzipped version is 436Mb. The combined size is more than the lambda limit for ephemeral storage which fails the deployment.
A streaming mode for unzipping the file would mitigate this.

So this is a little tricker than I thought. Because there are multiple files in a zip, we can't exactly stream unzip (from what I can tell reading online). Would the gzip format lend itself better?
If so we run into another challenge implementing this. The current approach for creating the application zip with the slim_handler mirrors the application zip needed by lambda. Lambda requires a zip file. So we'd have to separate functionality there assuming we go gzip with the slim_handler application.

Putting Slack convo w/ @mbeacom here: The commit above brings the whole response into memory.

I think I'm hitting exactly the same issue myself - #924

Could be made possible by https://github.com/boto/botocore/pull/1195

I'm thinking I might wait for this PR to be merged and for us to up botocore, then commit the necessary changes to handler.py.
Would that be preferable or should I take a crack at it now @mcrowson ?

I'm going to implement this for now.  If they ultimately handle it, we can update accordingly.

 I have seen your branch, @mbeacom, and I have implemented it in a similar and it seems to work (at least in my case). Do you want to do a PR or is there already one?

@nils-braun The branch I have out currently dumps the zip to memory (can be a problem with large deployments and is restricted to the memory allocated to the function). I haven't submitted a PR for this yet because we're looking to stream the zip file, uncompressing the contents on the fly.  This will free up both memory and disk resources.

Very good idea - maybe something like https://stackoverflow.com/questions/339053/how-do-you-unzip-very-large-files-in-python may help. I am definitely willing to help you with this PR, if you want or if you do not have the time to work on this now :-)

so it looks like zip files require random access. I understand this to mean that with a .zip file it is impossible to download and unzip on the fly as the whole zip will be required to decompress each file.
Alternatives could be to make gzipped tarballs instead for large application (keeping the handler as a .zip) or just to side step compression altogether and upload all the files to s3 and then its trivial to stream/download individual files to /tmp.

@mcrowson If you guys aren't opposed to the gzip idea, I could have this out tonight. I have that pretty much already setup and just need to format/commit it.

@mbeacom streaming gzip sounds great. Could you post a quick status and/or PR timeline when you get the chance?
There is an open PR waiting on movement in this thread after you last post.
#1022 is a small update to download the regular old zip into a memory file and then unzip it to /tmp.
It isn't as nice as a streaming .tar.gz solution but changing the slim_handler file format requires sweeping changes in cli.py, core.py and testing. To my eye, those updates look like they might take more than an evening :)
FYI @dswah

Sorry folks but I'm confused. Is the merge attached above expected to have fixed this issue? I'm still experiencing it.

That certainly was the intent. Got any logs or details?

I'll make sure I haven't done something wrong on my end tomorrow - I'm sure I have... I just wanted to double-check since the other issues referenced had been closed by not this one. Thanks!

So, it seems with a .tar.gz of 125M I was still running out of space. I managed to get that down to 115M by clearing .pyc files and that seems ok.
Error in cloudwatch for 125M tar:

Error
[Errno 28] No space left on device: OSError
Traceback (most recent call last):
File "/var/task/handler.py", line 509, in lambda_handler
return LambdaHandler.lambda_handler(event, context)
File "/var/task/handler.py", line 237, in lambda_handler
handler = cls()
File "/var/task/handler.py", line 102, in __init__
self.load_remote_project_archive(project_archive_path)
File "/var/task/handler.py", line 166, in load_remote_project_archive
t.extractall(project_folder)
File "/var/lang/lib/python3.6/tarfile.py", line 2007, in extractall
numeric_owner=numeric_owner)
File "/var/lang/lib/python3.6/tarfile.py", line 2049, in extract
numeric_owner=numeric_owner)
File "/var/lang/lib/python3.6/tarfile.py", line 2119, in _extract_member
self.makefile(tarinfo, targetpath)
File "/var/lang/lib/python3.6/tarfile.py", line 2168, in makefile
copyfileobj(source, target, tarinfo.size, ReadError, bufsize)
OSError: [Errno 28] No space left on device

Duration: 10683.37 ms	Billed Duration: 10700 ms Memory Size: 3008 MB	Max Memory Used: 601 MB

Sorry I'm kind of just dumping this here without time to really dive into the issue - just mentioning it in case it's of concern. Thanks!

Check the extracted size of your project. Sounds like it might be over 500.
You could try stripping unused symbols in any .so files within the deployment zip

The goal of the fix was to stream download the gzipped file and unzip it on the fly so we are not holding both the zipped and unzipped project in /tmp at the same time. I suspect your unzipped project might be close to 500M (you don't actually get all 500M, aws seems a little inconsistent on this limit, and the handler function itself I think takes up about 7M.

Closing due to lack of activity

i get the similar error with following trace:
[Errno 28] No space left on device: OSError
Traceback (most recent call last):
File "/var/task/handler.py", line 609, in lambda_handler
return LambdaHandler.lambda_handler(event, context)
File "/var/task/handler.py", line 240, in lambda_handler
handler = cls()
File "/var/task/handler.py", line 97, in init
self.load_remote_project_archive(project_archive_path)
File "/var/task/handler.py", line 169, in load_remote_project_archive
t.extractall(project_folder)
File "/var/lang/lib/python3.6/tarfile.py", line 2012, in extractall
numeric_owner=numeric_owner)
File "/var/lang/lib/python3.6/tarfile.py", line 2054, in extract
numeric_owner=numeric_owner)
File "/var/lang/lib/python3.6/tarfile.py", line 2124, in _extract_member
self.makefile(tarinfo, targetpath)
File "/var/lang/lib/python3.6/tarfile.py", line 2173, in makefile
copyfileobj(source, target, tarinfo.size, ReadError, bufsize)
File "/var/lang/lib/python3.6/tarfile.py", line 252, in copyfileobj
dst.write(buf)
OSError: [Errno 28] No space left on device
zappa settings:
{"dev": {
"app_function": "app.app",
"profile_name": "default",
"aws_region": "------",
"project_name": "----",
"runtime": "python3.6",
"s3_bucket": "------",
"timeout_seconds": 300,
"slim_handler": true
}
}


Suggesting to use anonymous delegate event handler leads to poor performance

I've just found out about an issue (https://github.com/dotnet/aspnetcore/issues/17886) which can dramatically affect the performance of a BlazorServer application which has a lot of data displayed on a page.
However, I could not find anywhere that this performance 'gotcha' is documented..and indeed the docs seem to also suffer from the same issue.
https://docs.microsoft.com/en-us/aspnet/core/blazor/components/event-handling?view=aspnetcore-5.0#lambda-expressions
It would be good to get clear documentation about the best way to bind an onclick event handler on a list of objects so as not to have poor performance.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: aa724f22-3a49-c7f6-1500-ac2d8dde5894
Version Independent ID: 5e8ef502-ccf9-659d-f25a-0f8f3c75f6e0
Content: ASP.NET Core Blazor event handling
Content Source: aspnetcore/blazor/components/event-handling.md
Product: aspnet-core
Technology: aspnetcore-blazor
GitHub Login: @guardrex
Microsoft Alias: riande

Thanks @darraghjones ... I'll get back to you no later than Monday morning on this.

Yes, @darraghjones ... I like your suggestion for covering this. I'll schedule this now, but just FYI on the timing of resolution: I'm working on major topic overhauls that might run all the way to when we start covering 6.0 and then 6.0 will take a while to address. I'm going to place a QUICK 🏃 cross-link to this issue in the topic, but I won't close the issue out ... this link will be temporary and this issue will remain open. I just can't say exactly when it will get worked. The cross-link that I'm about to place will surface this to readers in the meantime.


Add one more bucket for cross version tests

As we're releasing more 7.x versions.

@bot-gradle test and merge

Your PR is queued. See the queue page for details.

OK, I've already triggered a build for you.


Cherry-pick set storage account access to identity-based for feature store creati…

…on (#35941)

set storage account access to identity-based for feature store creation

revert

add workspace default storage role assignment

Description
Please add an informative description that covers that changes made by the pull request and link all relevant issues.
If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.
All SDK Contribution checklist:

[ ] The pull request does not introduce [breaking changes]
[ ] CHANGELOG is updated for new features, bug fixes or other significant changes.
[ ] I have read the contribution guidelines.

General Guidelines and Best Practices

[ ] Title of the pull request is clear and informative.
[ ] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

[ ] Pull request includes test coverage for the included changes.

API change check
API changes are not detected in this pull request.


Add settings view

There should be a settings view to allow the user to configre several aspects of the dashboard / clusters.
Acceptance Criteria:

[ ] There is a settings button and view available
[ ] At first, the settings should allow to see the details of all the clusters configured and change their accent color (#15)

Design:
TBD

@joaquimrocha is there a design ready for this

Not yet.

The design is close to finish.

I had added a mockup here but turns out it needs some final touch.

With github settings, I like how each section has it's own URL. So when you click on the sides or link to the settings from documentation or another part of the app it works.
What I don't like about github settings is you can't easily link to a section. Often there are many sections on a page, so you need to scroll down a lot. For example, if you click on the "Appearance" sidebar menu, and scroll down you see "Emoji skin tone preference". Would be better if there was an anchor on that section so people could link to it.

I think we can take "inspiration" from vscode for the way it handles settings for plugins, it allows plugins to have their own settings in a separate subsection.

Here is the latest design we have from @tsompura:

Also, about the search, I think it makes sense when we have more than a few options, i.e. more than one "page" of settings. This will likely happen in the future, but as an MVP for settings, I don't think search is needed.

Adding the points from our discussion.

In In-cluster mode it is import to make the message correct that the settings are specific to the user and not something a admin can set for the whole application. Like setting the language to french for example and expecting it to be the default for all users.
In In-cluster mode if the user sets the settings in a browser and accesses headlamp from another device or browser the settings will be completely different.