Problems connecting to Pokemon-Go Map

Have you validated that your config.json is valid JSON? Use http://jsonlint.com/ to check.
Yes JSON is validated.

Have you searched to see if there are other issues for the same issue? If so, comment on that issue instead.
Yes have not found any issues that are related.

Are you running master? We work on the dev branch and then add that functionality to master. Your issue may be fixed on dev and there is no need for this issue, just wait and it will eventually be merged to master.
Yes I am using most current dev release

Expected Behavior
Using config.map.json file it should be able to connect to PokemonGo-Map
Actual Behavior
Not receving any errors and able to read data from PokemonGo-Map
Your config.json (remove your credentials and any other private info)
{
    "auth_service": "ptc",
    "username": "username",
    "password": "password",
    "location": "xxxxxxx,-xxxxxxx",
    "gmapkey": "xxxxxxxxxxx",
    "encrypt_location": "",
    "tasks": [
      {
        "type": "HandleSoftBan"
      },
      {
        "type": "SleepSchedule",
        "config": {
          "enabled": true,
          "time": "01:54",
          "duration":"5:46",
          "time_random_offset": "00:24",
          "duration_random_offset": "00:43"
        }
      },
      {
        "type": "CollectLevelUpReward"
      },
      {
        "type": "IncubateEggs",
        "config": {
          "longer_eggs_first": true
        }
      },
      {
        "type": "UpdateLiveStats",
        "config": {
          "enabled": true,
          "min_interval": 10,
          "stats": ["uptime", "stardust_earned", "xp_earned", "xp_per_hour", "stops_visited"],
          "terminal_log": true,
          "terminal_title": true
        }
      },
      {
        "type": "TransferPokemon"
      },
      {
        "type": "EvolvePokemon",
        "config": {
          "evolve_all": "NONE",
          "evolve_cp_min": 300,
          "evolve_speed": 20,
          "use_lucky_egg": false
        }
      },
      {
        "type": "RecycleItems",
        "config": {
          "item_filter": {
                "Pokeball":     { "keep" : 20 },
                "Greatball":    { "keep" : 30 },
                "Ultraball":    { "keep" : 75 },
                "Potion":       { "keep" : 0 },
                "Super Potion": { "keep" : 5 },
                "Hyper Potion": { "keep" : 25 },
                "Max Potion":   { "keep" : 50 },
                "Revive":       { "keep" : 10 },
		"Max Revive":   { "keep" : 50 },
                "Razz Berry":   { "keep" : 7 }
          }
        }
      },
      {
        "type": "CatchVisiblePokemon"
      },
      {
        "type": "CatchLuredPokemon"
      },
      {
        "type": "SpinFort"
      },
      {
        "type": "MoveToMapPokemon",
        "config": {
          "address": "http://PokomonGo-Map-Server.com:5000",
          "max_distance": 15,
          "min_time": 60,
          "min_ball": 20,
          "prioritize_vips": true,
          "snipe": true,
  	  "snipe_high_prio_only": true,
	  "snipe_high_prio_threshold": 400,
          "update_map": false,
          "mode": "priority",
	  "map_path": "raw_data",
          "catch": {
            "==========Legendaries==========": 0,
            "Aerodactyl": 1000,
            "Snorlax": 1000,
            "Articuno": 1000,
            "Zapdos": 1000,
            "Moltres": 1000,
            "Dratini": 1000,
            "Dragonair": 1000,
            "Dragonite": 1000,
            "Mewtwo": 1000,
            "Mew": 1000,

            "==========Region Locked==========": 0,
            "Farfetch'd": 1000,
            "Kangaskhan": 1000,
            "Mr. Mime": 1000,
            "Tauros": 1000,

            "==========Very Rare==========": 0,
            "Lapras": 900,
            "Electabuzz": 900,
            "Magmar": 900,
            "Ditto": 900,

            "==========Starters==========": 0,
            "Bulbasaur": 400,
            "Ivysaur": 600,
            "Venusaur": 1000,

            "Charmander": 400,
            "Charmeleon": 600,
            "Charizard": 1000,

            "Squirtle": 400,
            "Wartortle": 600,
            "Blastoise": 1000,

            "Pikachu": 600,
            "Raichu": 1000,

            "==========Semi Rare==========": 0,
            "Porygon": 800,
            "Scyther": 200,
            "Jynx": 200,

            "==========Uncommon==========": 0,

            "Omanyte": 150,
            "Omastar": 500,

            "Seel": 300,
            "Dewgong": 500,

            "Grimer": 200,
            "Muk": 500,

            "Shellder": 200,
            "Cloyster": 500,

            "Gastly": 200,
            "Haunter": 500,
            "Gengar": 1000,

            "Onix": 600,

            "Drowzee": 600,

            "Hypno": 600,

            "Vulpix": 200,
            "Ninetales": 600,

            "Paras": 100,
            "Parasect": 200,

            "Growlithe": 200,
            "Arcanine": 700,

            "Tentacool": 200,
            "Tentacruel": 300,

            "Mankey": 150,
            "Primeape": 300,

            "Clefairy": 150,
            "Clefable": 500,

            "Jigglypuff": 150,
            "Wigglytuff": 500,

            "Venonat": 100,
            "Venomoth": 300,

            "Diglett": 200,
            "Dugtrio": 300,

            "Meowth": 250,
            "Persian": 300,

            "Psyduck": 150,
            "Golduck": 500,

            "Geodude": 100,
            "Graveler": 300,
            "Golem": 800,

            "Eevee": 200,
            "Vaporeon": 800,
            "Jolteon": 800,
            "Flareon": 800,

            "Kabuto": 150,
            "Kabutops": 500,

            "Magikarp": 150,
            "Gyarados": 800,

            "Pinsir": 150,

            "Ponyta": 200,
            "Rapidash": 300,

            "Slowpoke": 200,
            "Slowbro": 500,

            "Magnemite": 250,
            "Magneton": 500,

            "Krabby": 100,
            "Kingler": 300,

            "Voltorb": 200,
            "Electrode": 500,

            "Exeggcute": 250,
            "Exeggcutor": 500,

            "Cubone": 300,
            "Marowak": 800,

            "Hitmonlee": 400,

            "Hitmonchan": 400,

            "Lickitung": 500,

            "Koffing": 200,
            "Weezing": 500,

            "Rhyhorn": 200,
            "Rhydon": 500,

            "Chansey": 800,

            "Tangela": 300,

            "Horsea": 200,
            "Seadra": 600,

            "Goldeen": 150,
            "Seaking": 500,

            "Staryu": 200,
            "Starmie": 800,

            "==========T1 Evolvers==========": 0,
            "Caterpie": 10,
            "Metapod": 10,
            "Butterfree": 500,

            "Weedle": 10,
            "Kakuna": 10,
            "Beedrill": 300,

            "Pidgey": 10,
            "Pidgeotto": 10,
            "Pidgeot": 300,

            "==========T2 Evolvers==========": 0,
            "Nidoran F": 10,
            "Nidorina": 10,
            "Nidoqueen": 10,

            "Nidoran M": 10,
            "Nidorino": 10,
            "Nidoking": 10,

            "Oddish": 100,
            "Gloom": 200,
            "Vileplume": 600,

            "Poliwag": 200,
            "Poliwhirl": 300,
            "Poliwrath": 800,

            "Abra": 300,
            "Kadabra": 300,
            "Alakazam": 300,

            "Machop": 150,
            "Machoke": 300,
            "Machamp": 800,

            "Bellsprout": 100,
            "Weepinbell": 300,
            "Victreebel": 800,

            "==========Trash==========": 0,

            "Rattata": 10,
            "Raticate": 10,

            "Spearow": 10,
            "Fearow": 10,

            "Ekans": 10,
            "Arbok": 10,

            "Sandshrew": 10,
            "Sandslash": 10,

            "Zubat": 10,
            "Golbat": 10,

            "Doduo": 10,
            "Dodrio": 10

          }
        }
      },
      {
        "type": "MoveToFort"
      },
      {
        "type": "FollowSpiral"
      }
    ],
    "map_object_cache_time": 5,
    "forts": {
      "avoid_circles": true,
      "max_circle_size": 50
    },
    "websocket_server": false,
    "walk": 4.16,
    "action_wait_min": 1,
    "action_wait_max": 4,
    "debug": false,
    "test": false,
    "health_record": false,
    "location_cache": true,
    "distance_unit": "km",
    "reconnecting_timeout": 15,
    "catch_randomize_reticle_factor": 1.0,
    "catch_randomize_spin_factor": 1.0,
    "min_ultraball_to_keep": 10,
    "logging_color": true,
    "catch": {
      "any": {"catch_above_cp": 0, "catch_above_iv": 0, "logic": "or"},
      "// Example of always catching Rattata:": {},
      "// Rattata": { "always_catch" : true }
    },
    "release": {
      "Electabuzz": {"release_below_cp": 1500},
      "Aerodactyl": {"release_below_cp": 1400},
      "Arbok": {"release_below_cp": 1200},
      "Arcanine": {"release_below_cp": 1500},
      "Dragonite": {"release_beleow_cp": 2500},
      "Drowzee": {"release_below_cp": 1000},
      "Evee": {"release_bel0w_cp": 1000},
      "Exeggutor": {"release_below_cp": 2300},
      "Fearow": {"release_below_cp": 1300},
      "Flareon": {"release_below_cp": 2000},
      "Gengar": {"release_below_cp": 1300},
      "Golbat": {"release_below_cp": 1300},
      "Golem": {"release_below_cp": 1300},
      "Graveler": {"release_below_cp": 1300},
      "Dratini": {"release_below_cp": 600},
      "Dodrio": {"release_below_cp": 1300},
      "Pidgeot": {"release_below_cp": 1600},
      "Pinsir": {"release_below_cp": 1500},
      "Tangela": {"release_below_cp": 1199},
      "Tauros": {"release_below_cp": 1500},
      "Magikarp": {"release_below_cp": 190},
      "Raticate": {"always_release": true},
      "Kingler": {"release_below_cp": 1100},
      "Growlithe": {"release_below_cp": 1000},
      "Dodrio": {"release_below_cp": 1199},
      "Ponyta": {"release_below_cp": 1200},
      "Scyther": {"release_below_cp": 1200},
      "Snorlax": {"release_below_cp": 2300},
      "Gyrados": {"release_below_cp": 2200},
      "Hitmonchan": {"release_below_cp": 1000},
      "Hypno": {"release_below_cp": 1700},
      "Jolteon": {"release_below_cp": 1700},
      "Magmar": {"release_below_cp": 1500},
      "Parasect": {"release_below_cp": 1300},
      "Rapidash": {"release_below_cp": 1300},
      "Rhydon": {"release_below_cp": 1700},
      "Vaporeon": {"release_below_cp": 2300},
      "any": {"release_below_cp": 400, "release_below_iv": 0, "logic": "or"}
    },
    "vips" : {
         "Any pokemon put here directly force to use Berry & Best Ball to capture, to secure the capture rate!": {},
        "any": {"catch_above_cp": 1200, "catch_above_iv": 0.9, "logic": "or" },
        "Lapras": {},
        "Moltres": {},
        "Zapdos": {},
        "Articuno": {},

        "// S-Tier pokemons (if pokemon can be evolved into tier, list the representative)": {},
        "Mewtwo": {},
        "Dragonite": {},
        "Snorlax": {},
        "// Mew evolves to Mewtwo": {},
        "Mew": {},
        "Arcanine": {},
        "Vaporeon": {},
        "Gyarados": {},
        "Exeggutor": {},
        "Muk": {},
        "Weezing": {},
        "Flareon": {}
    }
}

Steps to Reproduce
Used most recent git clone -b develop https://github.com/PokemonGoMap/PokemonGo-Map.git
Used most recent git clone --recursive -b dev https://github.com/PokemonGoF/PokemonGo-Bot.git
Bot runs fine using config without map and PokemonGoMap loads and runs properly. However using the map example config, it doesn't seem to connect without giving me an error. I have done this many times before and it used to recently work a couple days ago. Curious if something may have changed that could be preventing this from happening.
Console messages:
2016-08-14 08:41:51,266 [       cli] [INFO] PokemonGO Bot v1.0
2016-08-14 08:41:51,270 [       cli] [INFO] Configuration initialized
2016-08-14 08:41:51,280 [PokemonGoBot] [INFO] [set_start_location] Setting start location.
2016-08-14 08:41:51,281 [PokemonGoBot] [INFO] [x] Coordinates found in passed in location, not geocoding.
2016-08-14 08:41:51,281 [PokemonGoBot] [INFO] [location_found] Location found: 43.6235669,-116.2096644 (43.6235669, -116.2096644, 0.0)
2016-08-14 08:41:51,281 [PokemonGoBot] [INFO] [position_update] Now at (43.6235669, -116.2096644, 0)
2016-08-14 08:41:51,282 [PokemonGoBot] [INFO] [login_started] Login procedure started.
2016-08-14 08:41:52,469 [PokemonGoBot] [INFO] [login_successful] Login successful.
2016-08-14 08:41:52,670 [PokemonGoBot] [INFO]
2016-08-14 08:41:52,670 [PokemonGoBot] [INFO] --- username ---
2016-08-14 08:41:52,670 [PokemonGoBot] [INFO] Level: 20 (Next Level: 16655 XP) (Total: 243345 XP)
2016-08-14 08:41:52,671 [PokemonGoBot] [INFO] Pokemon Captured: 798 | Pokestops Visited: 1465
2016-08-14 08:41:52,671 [PokemonGoBot] [INFO] Pokemon Bag: 44/250
2016-08-14 08:41:52,672 [PokemonGoBot] [INFO] Items: 273/350
2016-08-14 08:41:52,672 [PokemonGoBot] [INFO] Stardust: 116244 | Pokecoins: 0
2016-08-14 08:41:52,672 [PokemonGoBot] [INFO] PokeBalls: 96 | GreatBalls: 80 | UltraBalls: 39 | MasterBalls: 0
2016-08-14 08:41:52,672 [PokemonGoBot] [INFO] RazzBerries: 14 | BlukBerries: 0 | NanabBerries: 0
2016-08-14 08:41:52,673 [PokemonGoBot] [INFO] LuckyEgg: 5 | Incubator: 0 | TroyDisk: 5
2016-08-14 08:41:52,673 [PokemonGoBot] [INFO] Potion: 10 | SuperPotion: 4 | HyperPotion: 0 | MaxPotion: 0
2016-08-14 08:41:52,673 [PokemonGoBot] [INFO] Incense: 8 | IncenseSpicy: 0 | IncenseCool: 0
2016-08-14 08:41:52,673 [PokemonGoBot] [INFO] Revive: 10 | MaxRevive: 0
2016-08-14 08:41:52,673 [PokemonGoBot] [INFO]
2016-08-14 08:41:52,673 [PokemonGoBot] [INFO] Found encrypt.so! Platform: linux2 Encrypt.so directory: /var/www/p4999.xxx.net/PokemonGo-Bot
2016-08-14 08:41:52,674 [PokemonGoBot] [INFO]
2016-08-14 08:41:53,805 [SleepSchedule] [INFO] [next_sleep] Next sleep at 2016-08-15 01:50:55.805163
2016-08-14 08:41:54,924 [PokemonGoBot] [INFO] [bot_start] Starting bot...
2016-08-14 08:41:55,072 [CollectLevelUpReward] [INFO] [level_up_reward] Received level up reward: []
2016-08-14 08:41:55,073 [IncubateEggs] [INFO] [next_egg_incubates] Next egg incubates in 0.78 km
2016-08-14 08:41:56,118 [UpdateLiveStats] [INFO] [log_stats] Uptime : 0:00:05 | Earned 0 Stardust | +0 XP | 0 XP/h | Visited 0 stops
2016-08-14 08:41:56,335 [TransferPokemon] [INFO] [future_pokemon_release] Releasing Cubone [CP 264] [IV 0.56] based on rule: CP < 400 OR IV < 0
2016-08-14 08:41:56,545 [TransferPokemon] [INFO] [pokemon_release] Exchanged Cubone [CP 264] [IV 0.56] for candy.
2016-08-14 08:42:00,495 [MoveToMapPokemon] [INFO] [move_to_map_pokemon_fail] Failure! Map data was not valid
2016-08-14 08:42:00,581 [MoveToFort] [INFO] [moving_to_fort] Moving towards pokestop William E. Manning Gazebo - 0.06km
2016-08-14 08:42:02,857 [MoveToMapPokemon] [INFO] [move_to_map_pokemon_fail] Failure! Map data was not valid
2016-08-14 08:42:02,859 [MoveToFort] [INFO] [moving_to_fort] Moving towards pokestop William E. Manning Gazebo - 0.06km
2016-08-14 08:42:04,772 [IncubateEggs] [INFO] [next_egg_incubates] Next egg incubates in 0.77 km
2016-08-14 08:42:05,017 [MoveToMapPokemon] [INFO] [move_to_map_pokemon_fail] Failure! Map data was not valid
2016-08-14 08:42:05,019 [MoveToFort] [INFO] [moving_to_fort] Moving towards pokestop William E. Manning Gazebo - 0.06km
2016-08-14 08:42:06,357 [UpdateLiveStats] [INFO] [log_stats] Uptime : 0:00:15 | Earned 0 Stardust | +0 XP | 0 XP/h | Visited 0 stops
2016-08-14 08:42:07,939 [MoveToMapPokemon] [INFO] [move_to_map_pokemon_fail] Failure! Map data was not valid
2016-08-14 08:42:07,941 [MoveToFort] [INFO] [moving_to_fort] Moving towards pokestop William E. Manning Gazebo - 0.05km
2016-08-14 08:42:10,477 [MoveToMapPokemon] [INFO] [move_to_map_pokemon_fail] Failure! Map data was not valid
2016-08-14 08:42:10,479 [MoveToFort] [INFO] [moving_to_fort] Moving towards pokestop William E. Manning Gazebo - 0.05km
^C2016-08-14 08:42:11,168 [PokemonGoBot] [INFO] [bot_exit] Exiting bot.
Other Information
OS: Ubuntu
Git Commit: (run 'git log -n 1 --pretty=format:"%H"' and paste it here)
9b72ee50f26df288001a0cac90b1387129410d82
Python Version: (run 'python -V' and paste it here)
Python 2.7.6

Are you running PokemonGo-map on the same server as the bot or a different server?
What command are you using to load PokemonGo-map?
Have you followed the proper method for updating both PokemonGo-Bot and PokemonGo-Map? (i.e git pull, pip install -r requirements.txt --upgrade, npm install, npm run build etc. )

I am running this on a different server. This used to work just fine before.
python runserver.py -a ptc -u username  -p pass -st 10 -k mygoogleapikey -l "xx.xxxxxx,-xxx.xxxxx" -H my.mapdomain.com --db-type mysql --db-name radar --db-user user --db-pass pass --db-host localhost -P 5000
Yes I have. Everything works and runs properly. The bot works using a non map config and I can view the map and it is tracking and I do not receive any errors in console log.

#3874 has a similar issue, Hosting the bot & map on different servers needs to be investigated further

Still having problems with this?

Closing as we haven't heard anything.


[MessageQueueBundle] Route destination is not working as expected.

Hello,
I am using MessageQueueBundle with a configuration like this:
oro_message_queue:
    transport:
        ...
    client:
        router_destination: router

When any message is produced, it is created under router destination. It is expected that on a command oro:message-queue:consume it would be processed by messages processor, which copies the message and routes to listening processors. Unfortunately, the consumer keep listing the default destination as the router destination is not loaded into router configuration.
It works if I change the tag
{ name: 'oro_message_queue.client.message_processor', topicName: 'oro_message_queue.route_message' }

to
{ name: 'oro_message_queue.client.message_processor', topicName: 'oro_message_queue.route_message', destinationName: 'router' }

https://github.com/oroinc/platform/blob/master/src/Oro/Bundle/MessageQueueBundle/Resources/config/client.yml#L49

Hello, @aistis-  ,
Thank you for your report.
Created an internal task for the problem (id: BAP-15800).


User/adhammon/flickdemo

Perfected offset animation and fixed the tap-selection issue where an item would get selected that was different from the item that was tapped.

@ranjeshj can you merge this? Basically, all of this code is needed, but it might help to add your duplicate repeater back in for debugging purposes. Then maybe comment it out in the xaml for now.

            Images = await FlickApi.GetPhotos(args.QueryText.Replace(" ", "+"));

need to bypass here also ?

Refers to: test/Flick/MainPage.xaml.cs:143 in d5ec2f6. [](commit_id = d5ec2f61414603f0d4db3c646e36655310be2a2c, deletion_comment = False)


Use execa

Fixed in https://github.com/deep-foundation/npm-automation/commit/0b644f4b8ad75124f98260ebadea7830e2473735


[Bug] gemini-pro-vision无法识图

Bug Description
geminivision无法识图，上传图片发送后会报错，但是geminipro可以正常聊天，版本是最新版，使用Vercel 部署

Steps to Reproduce
切换到geminiprovision，上传图片并且填写内容识图，发送消息，会得到一个错误
Expected Behavior
输出识别的结果
Screenshots

Deployment Method

[ ] Docker
[X] Vercel
[ ] Server

Desktop OS
window11
Desktop Browser
edge
Desktop Browser Version
123.0.2420.32
Smartphone Device
No response
Smartphone OS
No response
Smartphone Browser
No response
Smartphone Browser Version
No response
Additional Logs
{
  "error": true,
  "message": "An internal error has occurred. Please retry or report in https://developers.generativeai.google/guide/troubleshooting"
}

No response

Bug Description
geminivision无法识图，上传图片发送后会报错，但是geminipro可以正常聊天，版本是最新版，使用Vercel 部署

Steps to Reproduce
切换到geminiprovision，上传图片并且填写内容识图，发送消息，会得到一个错误
Expected Behavior
输出识别的结果
Screenshots

Deployment Method

[ ]  Docker
[x]  Vercel
[ ]  Server

Desktop OS
window11
Desktop Browser
edge
Desktop Browser Version
123.0.2420.32
Smartphone Device
No response
Smartphone OS
No response
Smartphone Browser
No response
Smartphone Browser Version
No response
Additional Logs
{
  "error": true,
  "message": "An internal error has occurred. Please retry or report in https://developers.generativeai.google/guide/troubleshooting"
}

No response

I am pretty sure now that the internal error is caused by the issue mentioned in #4303, which needs to be improved.


When exit_code or run is invoked, the task does not complete (fwrite() error)

Castor 0.14.0 (Phar)
PHP 8.3.4
PowerShell 7.4.1 on Windows 11
Everytime I try to run a task that includes a call to run() or exit_code(), the task does not complete. I have to either Ctrl+C or press Enter to exit the task, and then an error is displayed:
In AbstractPipes.php line 139:

  Notice: fwrite(): Write of 2 bytes failed with errno=22 Invalid argument

The command is OK, because I can see its output right after this error message.
A sample task triggering this error:
#[AsTask]
function phpVersion(): void {
  run("php --version"); // Using a string or an array as argument does not change anything.
}

This error does not occur if I use Symfony Process directly (i.e. (new Process(["php", "--version"]))->run()).

Thanks for the report.
I don't use windows, but we'll find a way to help you!
In the meantime, if you can try to debug it, it would be awesome. If not, don't worry!

A first track: it is related to the PTY.
If I disable PTY (either globally via a context, or locally in the run() call), everything is OK.


[RESTEASY-3538] Update the way the media type for a response is deter…

…mined. Allow the previous negotiation to work with a configuration property.
https://issues.redhat.com/browse/RESTEASY-3538

I think this might need to be reversed and opt-in vs opt-out. Though it's closer to what the specification indicates should be happening, it's a rather large change in the way the media type is resolved for RESTEasy.


feat: configurable log prefix

For adjusting prefix of output, e.g. to add prefix string or log formatting flags.
Format:

prefix: string until first occurance of %
flag: combination of flags

Flags:

%d - date
%t - time
%m - microseconds
%l - long file name
%s - short file name
%z - use UTC
%p - move the "prefix" from the beginning of the line to before the message
%S - datetime  - same as "%d %t"

Basically the meaning is the same as in std log library:
https://pkg.go.dev/log#pkg-constants

Rebased to be sure and that passes.


Lip Upper A and Lip Lower A are not editable

Position, rotation, and scale will not work on both Lip Upper A and Lip Lower A.
Race: Lalafell male
Please let me know if more information is required!

Yeah those bones are just kinda fucky wucky. They behave different to all others internally for some reason. Can check someday but it's admittedly very low prio.


Update README to include static assets

Do you think we should change it to resources/public? If someone wanted mydomain.com/assets/something.js they'd have to do resources/assets/assets.

Yes, that would seem to be consistent with node.js and Sinatra examples. (Although equally then you could say if someone wanted mydomain.com/public/photo.jpg they'd have to use resources/public/public :wink:)

Let's do it. I think assets/ is a pretty normal thing.

Oops, should I have merged this @digitalfx ? I apparently lost track of it.

Don't worry, I just went through and cleared any pull requests that were going stale, nothing important.


[FEATURE] Standardize, setup, report, and increase test coverage

Setup code coverage, once reporting from CI/CD analyze the test gap and fill it.
See the meta issue https://github.com/opensearch-project/opensearch-clients/issues/30 for details.

codecov.io is already in use by other clients and opensearch projects for reporting, so that is essentially settled.
To do the actual coverage collection, it appears the main options are directly with the compiler https://doc.rust-lang.org/rustc/instrument-coverage.html or with https://github.com/xd009642/tarpaulin.
It appears to me that the compiler's support is the new best practice, and using something like grcov to get lcov output to pass to codecov

@Xtansia this can be closed.


'SASS: Basics' deck needs more questions / answers

Add to deck titled 'SASS: Basics' with additional questions and answers (no limit on # really) Fill in here and submit pull request.
For reference, concepts found here: http://sass-lang.com/guide  or some other good question and answer format for basics

Have added a few in this PR https://github.com/papistan/FrontEndTrivia/pull/85 :)


NeuroSpell : neural spell checker + neural MT

Just to let you know what I'm currently experimenting...
I built a neural spell checker. Even in the very first version, I obtain very incredible results.
The spell checker is linked with an automatic translator, to translate the corrected texts.
Both made with MMT, powered by its great live-tuning feature !
http://neurospell.com/
Thanks to the MMT team !
:+1:

You are awesome @EtienneAb3d ! Congratulations!
Any chance you can share what you did in terms of the neural spell-checker. What data did you need to feed? Do you simply train as you do with the neural machine translation part and the only difference is the data input? Thanks in advance!

Hmmm.. as this spell checker is the first I know using a neural net, I prefer to keep the recipe for me at this time, and see what will come with it.
Perhaps I will explain it later, in a near future. Be sure this place will certainly be the first to know.
What I can say is that the method is very simple.
;-)

There are SO MANY applications for this (inbound data cleansing comes to mind). Looking forward to see this evolve!  Nice work.

As far as I know, this is the very first "spell corrector", while all others are only "spell checkers".
Spell checkers  often leave the user with highlighted doubts, and rules to be decided. But, a bad, or very bad, writer often don't know what to do with the provided rules. It was my case when I was younger !
NeuroSpell directly show the correction of the text entered, with a high capability to be accurate (even in this very first version).
More than this, ordinary spell checkers are quickly lost when the writer is an awful one, like what we see in the social networks, while NeuroSpell can fix even the harder (be not all kind of errors).

Is there a date for availability of this tool?  Would LOVE to test it :)

A link to the first french very is provided above, in the first post. You can test it here. Of course, to test pertinent entries, you will need to know the usual kind of errors of french writers.
http://neurospell.com
A new release of this french version is in preparation.
An english one will come quickly.

The very first english version is inline:
http://neurospell.com/en.php
There is a lot to do to improve. But, here is an example of what it can do:

Just a remark : this tool is made for human writers, if you would like to evaluate its behaviour, it's better to enter some texts that would be human-plausible. :-)

I tested it with this sentence "The naturel couse of thes crisi will end son.". I am not sure if it's human-plausible or not :-)
You can see the result in the screen shot.

I think that, usually, a human, especially native for the language, when really trying to write a sentence, won't try to write something being not phonetically almost correct. There are already so much ways to write something wrong but phonetically almost correct...
In your case, if you read your wrong words, you won't get something really understandable.
"naturel" is perhaps a word that could have been plausible. I will improve for such a case.
;-)

For example:

Experimenting with your example, I notice that "son" wouldn't be corrected, certainly because a real word. Note: this MMT model is at early stage of the training, possibly it will more efficient with more training time.

It looks good and promising. I was just testing it and sharing with you what I found so you can improve it :-)

Oops.. I didn't see that the "end" wasn't correct in the latest version of my sentence, while it was in the previous one. Not perfect..

Note how "while" is changed in "will" when "is" is changed in "be", and with "?" at the end:

(I also removed "the" that was an extra word lost by error in my attempts)

@EtienneAb3d thanks for the demo. I think you may have some insights about my question here: https://github.com/modernmt/MMT/issues/448
Would you mind taking a look?

NeuroSpell is now an hybrid system, combining a ModernMT neural network, with a lexical search, a POS-tagger, grammar rules, and a statistical model. I wrote a short explanation on how NeuroSpell is working, here (see "How does it work ?" button):
http://neurospell.com/en.php
Also available in french, here:
http://neurospell.com
ModernMT is quoted in these explanations, like on the main web page.
Thanks to the MMT team for making all this possible !

@EtienneAb3d would you mind sharing the code for spell checker if its open source? Moreover, can you tell me the specs for the server you use to run neurospell (gpu, cpu and ram)?

@Hasan0ff, NeuroSpell is using ModernMT and LanguareTool, both open-source, but for the moment, is not open-source itself. It uses proprietary code.
It's free to use using its web interface, and will certainly stay free for this kind of access.
It's written in Java. It's currently running on a Linux machine, and does not need large CPU, nor large RAM. ModernMT is running on a GTX 1080 Ti card.
If you want, it can be trained/tuned on your own data.
It uses a Java XML-RPC server, with an API I can share (not free).
I can install all on your own server for a private secure use (not free).
As said above, you will find some minimal explanations on the way it's working on the web site.
;-)

Hi @EtienneAb3d
thanks for having shared this, and compliments for the great job! :)

Version 1.0 beta of NeuroSpell for English is online.
Perhaps some of you may be interested in this kind of automatic corrections:

V1 for French and V0 for Spanish are in preparation.
Then, I will release a version for a new language every 10-15 days. I hope to be able provide with all 24 EU languages for the beginning of 2022.
Thanks to ModernMT team that enables this to exist!

Thanks @EtienneAb3d for keeping this issue updated! This looks super cool. I hope all is well with you.
Good luck!


[#129419545] Create new PR pipeline for GPDB

Add new pullrequest_resource through docker image at xinzweb:pr/latest
Add github pull request pipeline pr_pipeline.yml

Signed-off-by: Karthikeyan Jambu Rajaraman<EMAIL_ADDRESS>

WIP


data refs

Why was this closed without merging? I'm wondering why everything has to be boxed.

Why was this closed without merging? I'm wondering why everything has to be boxed.

1

It seems to add unnecessary heap allocation that this PR's work on Plot removes.

1

It seems to add unnecessary heap allocation that this PR's work on Plot removes.


fix(core): only list admin repos

fixes #1
CI requires #2 to be run before this can pass

makes sense, a bit of text at the end on the non admin ones that says "can't be deleted by you" could be good IMO

I made it into an option (--only-admin); and by default added a text which says you are admin or you are not admin (in green or red)


Ccxt fixes

There are a lot of very minor changes in this push. Basically, there are a handful of missing pieces I put in.
This is not complete yet. It might be 2 or 3 days before I can get a full run in. I just wanted to check with you on replacing the None lists with empty lists. I'm not sure if this is the right call or if it should be done earlier in the process.

This should be clean. I'm running another full pull now to be sure everything works as expected.

I made a full pull and everything came up aces. This is good to go with real-world data.


Access Metadata in service

Hi,
right now, I am migrating a bunch of gRPC services to mu-scala. Those Services heavily use Metadata to store JWT tokens.
Is there a way to access Metadata in the service?

Hi @ThatScalaGuy!
I would say that one of the best options is to create your interceptor. We have an example of using interceptors for the metrics. Take a look at how they are added to the server and the client here:

https://higherkindness.io/mu-scala/guides/metrics-reporting

And then the source code of the implementation:

https://github.com/higherkindness/mu-scala/blob/e38a8539f56019fd8b66010f998c84f876f4e652/modules/server/src/main/scala/higherkindness/mu/rpc/server/metrics/MetricsServerInterceptor.scala#L26

https://github.com/higherkindness/mu-scala/blob/ccd8274d90c1979b4c7df035223cdaecd370bca3/modules/service/src/main/scala/higherkindness/mu/rpc/channel/metrics/MetricsChannelInterceptor.scala#L27

Let me know if you have any doubts.

Hi, @fedefernandez
Sorry for the late reply.
Your suggestions were quite helpful for another issue I had.  But unfortunately, it does not solve the problem I have right now.
I see no way to access the metadata directly in the service.
I think it needs some adoption in the macro and code generation part.
trait Greeter[F[_]] {
    def SayHello(req: HelloRequest): F[HelloResponse]
  }

Will become
trait Greeter[F[_]] {
    def SayHello(req: HelloRequest, meta: Metadata): F[HelloResponse]
  }

Next week I will spend some afford to adopt your library. I am looking forward to finding an implementation that fits in the project's roadmap.
Open for any discussion. Hopefully, my changes will be in the main branch soon

@ThatScalaGuy oh, I understand now. Yeah, at this moment is not possible. Your suggestion could make sense but the macro doesn't change the public interface. Another option is to have all the request objects extending from a type that contains the metadata. This is something we evaluated in the past.

@fedefernandez hi, finally, I fixed all M1 issues, and I can start working on that topic.
My approach is inspired by the akka grpc implementation I am currently using. They call it power API. In the end they have two traits - one with metadata and one without -
https://doc.akka.io/docs/akka-grpc/current/server/details.html
I don't know if that is the best approach, but it introduced no breaking changes. And you have a clean interface if you don't need metadata.
Your idea is also valid, but I have no idea for nice-looking client implementation. (or I misunderstood you)
Can you provide some sample code of the final trait and what client calls look like in the end? Probably that will help me to understand your thoughts.

ok, after reading your comment again, I understand your point.

@ThatScalaGuy thanks for the explanation, the approach of having two different traits could be a good choice.

I have a use case for this as well. This is effectively the way one can send arbitrary non-contextual information to the call itself. For additional logging, auth, etc without modification of the data. One ideally would be able to realize it on both the sender and on the receiver.
Similar to what the natchez tracing integration does.

@ThatScalaGuy please, let me know if this address your request
https://higherkindness.io/mu-scala/guides/accessing-metadata
The sbt plugin is on its way to maven (https://github.com/higherkindness/sbt-mu-srcgen/actions/runs/1739772895).

@fedefernandez yep, looks promising.

@fedefernandez migrated the last 15 services. No issues have been found so far. From my side, the issue can be closed.

@ThatScalaGuy thanks for letting me know!


Broken links

Commit 77cabebcd4b41da0083cb2c3c71105ba165debd6 introduced new URLs to package.json including URLs for the GitHub repository that yield 404 error pages for me. Is it possible that https://github.com/tape-testling/tape should be https://github.com/tape-testing/tape?
This manifests in the 'Repository' link from https://www.npmjs.com/package/tape?activeTab=versions.

whoops, yep, that's indeed the case :-)


[RFC][Cryptography] Modernize the cryptography implementation

Significant progress has been made during recent years due to the development of blockchain. However, these cryptography protocols are hard to implement correctly and even more hard to parallelize. A lot of them can be efficiently parallelized, and I will list some of them later. It shares a  data-parallel nature with deep learning tasks.
Existing new papers are doing the experiment in single-thread mode, and claiming that it's parallelizable, for example  Ligero, Libra. I am an author of Libra (not the facebook libra), and I tried to implement a parallelized one. There are several reasons for not presenting the parallelized program in our paper:

The zero-knowledge community usually doesn't do the parallelized implementation, and it's considered unfair to do this. If we can make an easy tool to parallelize it, it will gradually become a standard way for the community, and no fairness problem.
It's tricky to deal with cache misses. It will be nice to have an automatic tool to balance the parallelism and cache misses, and even deliver GPU&ASIC implementations.

Example applications
Merkle tree
Merkle tree enables Alice to commit their secret data and Bob can verify the membership of that secret data. Alice cannot modify the secret data after the commitment is made.
It builds a binary tree, where leaves are the data itself, and for every parent node, it hashes the child node and stores the hash value. Alice will output the root node as the commitment. Any data modify will change the root completely, so it will preserve the data integrity. The structure enables Bob to ask Alice what's the value is at a specific leaf node, then Alice can provide the whole tree path from that leaf node to the root. Bob can verify the integrity of data by doing hash. And checking the hash result is identical to the root.
Such structure is parallelizable, we can parallel evaluate hashes for each node. And we can finish the commitment generation in only O(log n) rounds.
Polynomial commitment
Polynomial commitment enables Alice to commit to a polynomial F(x). After she committed the polynomial, she cannot change the polynomial, otherwise, the change will be detected in verification phase.
The verification phase(or opening phase), will open the commitment to a specific point z, and it will return the polynomial value F(z) as well as a proof for the validity of the value (say the value is actually derived from the polynomial that is committed before).
This can be implemented by a combination of NTTs (FFT in finite fields) and some other minor parts. So it can be parallelized efficiently like FFT.
Zero-knowledge proofs
It's a bit hard to explain, but it can be constructed from polynomial commitments. Industrial level implementations actually do parallelization but it's great if we can make a tool for such tasks.
Major Todos (for now)
Implement basic primitives

Collision-resistant hash function
Finite field operations
Pseudorandom generator
Bilinear pairing
Encryption & Decryption algorithms
Pedersen commitment
Comment to add more!

Implement a demo project (Proof of Concept)
I could help to implement our zero-knowledge proofs protocol using TVM, and hopefully, we can take advantage of the data parallelism. In my own implementation, I tried to hand-code the AVX2 codes and some assembly codes to make it faster which look very old-school.
This implementation will include implementing all primitives that I mentioned in the previous section and we do have a C++ implementation as a reference. I could DIY it and submit the code later. Most likely, I will use the Python interface.
A clear developer guide for Rust programmers
It's better to have a Rust tutorial because many security companies prefer to use rust.

Some story
When I was writing Libra and it’s followup, @merrymercy come and asks “why are you implementing this with a handwritten AVX2 code? It’s already the year 9012! Try tvm instead.”

Interesting, cc @nhynes regarding rust interface.

rust interface

The rust interface is currently only that of a TVM runtime, but that's sufficient since the kernels are already memory safe. For maximum safety (but slightly less flexibility from dynamic linking), one would use the [non-bindings] runtime in rust/runtime. At least until TVM exposes a C FFI to the compiler internals, developers will necessarily have a polyglot workflow.

Interesting, cc @nhynes regarding rust interface.

Shall the basic primitives implemented in the runtime? Or it could be designed with either hybrid script or ir_builder, I mean the primitives could be generated.

Shall the basic primitives implemented in the runtime? Or it could be designed with either hybrid script or ir_builder, I mean the primitives could be generated.

I would prefer "intrinsic"

Hi Tiancheng,
It would be super excited and great impact if TVM is enabled to express crypto protocols and primitives. While I think the RFC does a perfect job in enumerating all the tasks from the crypto side, would you mind talking about something on the compiler side? For example, it would be great for the community to know how many of those primitives can be expressed as intrinsic (links will be helpful), and whether others could be abstracted as op.

closing for now due to inactive status, feel free to reopen


It doesn't support Passenger 5 Standalone

1st. Passenger version in the config file should be 3 or 4
2nd. Passenger standalone is not being added to Gemfile.

I saw you started working on support for passenger 5.
I would happily merge a PR for support of Passenger 5. Please do include a test output for passenger 5 stats commands. I suppose they have not changed the format but anyway.
I do not understand your second point. This plugin is meant to work standalone (i.e. not being embedded into the application which is being served by passenger). Therefor it is expected to have passenger executables available system wide. You can always configure the paths to the executables to meet your specific system.

Passenger 5 is now fully supported


Text and separator colors different

For some reason, at least visually, it looks like the text and separators are using different colors:

That same issue was discussed on #90
Can you check if it solves your problem and, if it does, close the issue?

Yep, I use iTerm with transparency. The problem was mentioned in #56 actually. Thanks!

Set "Keep background colours opaque"


docs: add debsouryadatta as a contributor for doc

Add @debsouryadatta as a contributor for doc.
This was requested by agamjotsingh18 in this comment

@debsouryadatta could you work on #118 which automates this process

@debsouryadatta could you work on #118 which automates this process

I can try but which things will I require for automating, can you please guide.


Test coverage

We just ran the tests and are concerned about test coverage. Perhaps we are missing some key features particularly in tests/test_patient.py

Won't have enough time to fix all this. Will steal answers from Stelios!


Update README to include DataFrames and zinc.

Also cut trailing whitespaces.

Merged build triggered.

Merged build started.

Test build #33880 has started for   PR 6548 at commit 630efc3.

Test build #33880 has finished for   PR 6548 at commit 630efc3.

This patch passes all tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
case class SortOrder(child: Expression, direction: SortDirection) extends Expression
abstract class BinaryMathExpression(f: (Double, Double) => Double, name: String)

Merged build finished. Test PASSed.


Unnested Parsers and Formatters

I unnested the parsers and formatters. The whole experiment with nesting per encoding was not super successful.
@ahsonkhan, @GrabYourPitchforks, @joshfree, @ianhays, @AtsushiKan

@dotnet-bot test Innerloop Ubuntu16.04 Debug Build and Test


[WIP] Backpack v6

This is the working branch for Backpack v6. We'll make sure to note here everything we merge into it, and any breaking changes we introduce.
Already merged into this branch:

[x] https://github.com/Laravel-Backpack/CRUD/pull/4878
[x] ✅ - https://github.com/Laravel-Backpack/CRUD/pull/4815
[x] https://github.com/Laravel-Backpack/CRUD/pull/4675
[x] https://github.com/Laravel-Backpack/CRUD/pull/4933
[x] https://github.com/Laravel-Backpack/CRUD/pull/4942

To be merged, before the final release:

[ ] main into main-without-assets
[ ] main-without-assets into this branch
[ ] this branch into main

Breaking changes:

No longer need public/packages, you can delete it using rm -rf public/packages && php artisan backpack:filemanager:install

Change base view files - see https://github.com/Laravel-Backpack/CRUD/pull/4815 for differences.

A new inspection was created.

The inspection completed: No new issues

A new inspection was created.

A new inspection was created.

The inspection completed: 706 Issues, 104 Patches

A new inspection was created.

A new inspection was created.

A new inspection was created.

The inspection completed: 794 Issues, 104 Patches

A new inspection was created.

A new inspection was created.

A new inspection was created.

A new inspection was created.

A new inspection was created.

A new inspection was created.

A new inspection was created.

The inspection completed: 794 Issues, 104 Patches

The inspection completed: 794 Issues, 104 Patches

A new inspection was created.

A new inspection was created.

A new inspection was created.

A new inspection was created.

A new inspection was created.

A new inspection was created.

A new inspection was created.

A new inspection was created.

A new inspection was created.

The inspection completed: 797 Issues, 103 Patches

A new inspection was created.

The inspection completed: 797 Issues, 103 Patches

A new inspection was created.

I have great news! 🥁🥁🥁 We now have stable branches for v6, for all our main packages!
We now have:

a stable branch of CRUD - v6 (works with both BS4 and BS5)
a stable branch of PRO - v6  (works with both BS4 and BS5)
a stable branch of Demo - v6  (can change the theme in config/backpack/base.php under view_namespace)
themes completely separated into their own packages

https://github.com/Laravel-Backpack/theme-coreuiv2
https://github.com/Laravel-Backpack/theme-coreuiv4
https://github.com/Laravel-Backpack/theme-tabler

I'll give them all another look tomorrow. I might have missed some stuff. But I'm super super excited... we can now merge stuff into v6, add new features, etc. Woohooo 🎉

A new inspection was created.

A new inspection was created.

A new inspection was created.

The inspection completed: 797 Issues, 103 Patches

A new inspection was created.

The inspection completed: 797 Issues, 103 Patches

A new inspection was created.

The inspection completed: 797 Issues, 103 Patches

A new inspection was created.

A new inspection was created.

A new inspection was created.

A new inspection was created.

A new inspection was created.

A new inspection was created.


🐛 Bug Report — TypeError: memory limit has been exceeded with inline data: URL

What is happening
When serving an HTML file with a large (>10MB) inline data: URL resource, even a basic worker will halt the response and respond with:
TypeError: Parser error: The memory limit has been exceeded.
I thought this was simply the response size, but this is not the case.

If I send the file as text/plain, the file will send through the worker
If I generate a large HTML file with /dev/random, the file will send through the worker
The response truncates right at the point in the file that a data URL starts

So, it does seem to me to be very specific to inline data URLs.
Does this imply the worker fetch() is somehow inspecting the data URL during streaming? This seems odd, but if so, is there a missing option to disable this?
Reproducing

Run a minimal worker
Output an HTML file with a large inline data resource
Try to fetch the file through the worker

Example data URL HTML generator:
#!/bin/sh
content=$(dd if=/dev/random bs=1MB count=10 | base64 -w0)
echo ""

Generate the HTML file and serve it:
% ./gen.sh > 10mb.html
% python -m http.server 9000

And the worker:
export default {
  async fetch(request, env, ctx) {
    const response = await fetch("http://localhost:9000/10mb.html");
    return response;
  }
}

Run and try to fetch:
% wrangler dev test.js
% curl -o - http://localhost:8787 > /dev/null
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
             Dload  Upload   Total   Spent    Left  Speed
100    25    0    25    0     0     46      0 --:--:-- --:--:-- --:--:--    46

Notice only 25 bytes sent, which is the start of the img element
% dd if=10mb.html bs=25 count=1

I'm unable to reproduce any failure here with workerd given the example included. The error that you mention ("Parser error: The memory limit has been exceeded") is an error that HTMLRewriter would throw (it comes from lol-html). Your example is not using HTMLRewriter, however so I'm a bit confused. Can you please clarify?
Also, are you seeing this error with a production worker (e.g. wrangler deploy, run the worker) or in local dev (e.g. wrangler dev), etc.

This has me incredibly confused as well, there is indeed no instance of HTMLRewriter. What I posted as the worker script is what I am testing with, in a fresh/empty directory too, and running the wrangler dev command I noted above.
The exception is from the html-rewriter code though:
✘ [ERROR] workerd/server/server.c++:3422: error: Uncaught exception: workerd/api/html-rewriter.c++:99: failed: remote.jsg.TypeError: Parser error: The memory limit has been exceeded.

A couple more pieces:
% npm list
<EMAIL_ADDRESS>/tmp/test
├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>├──<EMAIL_ADDRESS>└──<EMAIL_ADDRESS>
Also, I notice that the first request will succeed with a bad response (no error but only 25 bytes sent) and the second request will fail with a bad response (error raised and only 25 bytes sent).

I can only follow along loosely with C++, but notice there is implicit parsing of data URLs outside the HTML rewriter:
https://github.com/cloudflare/workerd/blob/a9cf631a97194d0c2d6d46c281d874b1c5665fc8/src/workerd/api/data-url.c%2B%2B#L17
It seems like there is some processing of data URLs as sub requests inside a fetch() call?

The DataUrl implementation is entirely separate from the HTMLRewriter and we do not automatically parse data urls that are embedded in a stream. The only place a data: URL is handled is if you are explicitly passing that to a fetch call, e.g. await fetch('data:...'). There's nowhere else in the code where it is used directly.

Yeah I saw that parsing of the fetch() URL was covered there, I didn't see any tests describing what I'm noticing in the worker example above though.
When you say you aren't able to reproduce this bug, what do you notice on the response? Are you getting 25 bytes back, or the full 10MB?
Would a docker compose or something help verify this bug? I could stumble through rebuilding workerd too, there might be some way to catch what is happening with the data URL? I was sure that the minimal repro steps here would surface this bug for you, but I'm rather confused all around now.

When you say you aren't able to reproduce this bug, what do you notice on the response? Are you getting 25 bytes back, or the full 10MB?

Keeping in mind that I'm testing with workerd only (not wrangler dev) ... I get the full response.

I don't know enough about using workerd directly, if there is something I can run locally and confirm what you're seeing, let me know.
Is it possible this is specific to wrangler/workers-sdk otherwise?

It's possible since in that path something may be injecting polyfills and maybe HTMLRewriter use into the worker. Take a look through the compiled source that the CLI generates and see if you can spot anywhere HTMLRewriter may be getting added.

Are you describing generating this with Wrangler? With something like:
% wrangler deploy --dry-run --outdir dist

When I do that, the bundled file looks like this:
// test.js
var test_default = {
  async fetch(request, env, ctx) {
    const response = await fetch("http://localhost:9000/10mb.html");
    return response;
  }
};
export {
  test_default as default
};
//# sourceMappingURL=test.js.map

I don't know exactly what to generate here, so here's a docker compose with the minimal reproduction. This is just the example above, but isolated via containers to prove that there is indeed no HTMLWriter defined at any point in the worker.
https://github.com/agjohnson/wrangler-large-data-url
Let me know if any part of that isn't clear. If this seems like a wrangler issue, could we transfer the issue?


Provide a meaningful port number for the generated service snippets

Description:
import ballerina/http;
service  on new http:Listener(0) {

}

As shown above, the auto-complete snippet generates the service with the port 0. Instead shall we provide a port number such as 8080?
Affected Versions:
Swanlake-beta6 at least

For the explicit new expression we generate values for required parameters of the init function  using the getDefaultValueForType() method. Hense, special casing looking at the parameter name is not ideal IMHO. WDYT @nadeeshaan ?

@malinthar yes, Since we use the generic implementation and we cannot rely on the param name that is not straight forward. We might need to have some sort of a meta information to do so. Maybe a meta annotation.
@shafreenAnfar thoughts?

Yeah, some default would be nice but I don't mind the current experience either. I feel if there is no straight forward way, we can park this problem and revisit later.

Closing this as a low-priority task with the Icebox label might reopen in the future.


Does torch-rnn distinguish lower and upper case?

Today I train a text file, which I believe that there are 50 different symbols (from a..z A..Z and 0,1)
However, the train.lua reported that
Total vocabulary size: 25
Does torch-rnn distinguish between a and A? Well, I can test by myself, but wanna ask from experts too.

It should distinguish between upper and lower case.
On Thu, May 19, 2016 at 7:34 AM, Vinh Dang<EMAIL_ADDRESS>wrote:

Today I train a text file, which I believe that there are 50 different
symbols (from a..z A..Z and 0,1)
However, the train.lua reported that
Total vocabulary size: 25
Does torch-rnn distinguish between a and A? Well, I can test by myself,
but wanna ask from experts too.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub
https://github.com/jcjohnson/torch-rnn/issues/96


Connection refused to port 8675, RPi

Hi
setup.sh seemed to work fine while installing on a RPi4; however, when I pull up Powerwall Power Flow dashboard, the Power Flow window shows "Unable to connect" to localhost:8675. If I point a browser to that port, I get a similar message about site can't be reached.
Any suggestions? Note, my powerwall+ and solar was just installed, but the inverter has some issues and so the system is in standby as they try to troubleshoot that. However, if I log into the gateway it shows the Tesla graphic with power being supplied by the grid. So that's working.
Thanks!

Sorry, I've moved this to discussion, as it's very likely the problem is on my end.

Hi @maxEntropyProd thanks for opening the issue!   A few things to try:

Ensure you do not have another browser window/tab open that is showing the animation.  Chrome and other browsers prevent the iframe from rendering if it opened more than once (I would like someone to explain this to me at some point :)
Several of the browsers do not like iframes on "localhost" so try to use the IP address instead (e.g. http://<IP_ADDRESS>:9000/).
Try to view the animation directly from the pyPowerwall proxy by going to this: http://<IP_ADDRESS>:8675/ - also make sure the latest pypowerwall was installed (e.g. v0.5.1): http://<IP_ADDRESS>:8675/stats (of course replace the IP address with your RPi)

Moving to https://github.com/jasonacox/Powerwall-Dashboard/discussions/55


fix(ng): use $evalAsync instead of $apply to avoid $rootScope:inprog

Resolves #736.
There are a lot of discussions over $timeout vs $evalAsync, but it seems the latter is better for avoiding the $rootScope:inprog error that we can get calling $apply directly.
We could possibly replace the local vendor lib with individual libs (like angular-ui-date for this one), but that's a much larger task than fixing this bug in our copy of the library.

It appears my editor cleaned up extra whitespace in angular-ui.js. The relevant change is on line 1092.


Occasional lag when killing in Emacs

This is not yet consistently reproducible, but the symptom is similar to the problem fixed in 8c0a283fbf4d17255e246b3c1aae6f4101aedeaa. I think this issue is also caused by setting save-interprogram-paste-before-kill, but the delay is caused by a large amount of data being copied from the system clipboard into Emacs (instead of by .zshrc being sourced). Thus, I expect the problem to be reproducible by copying a large amount of data to the system clipboard and then killing something in Emacs. I'm not yet sure, though.
I resolved the problem temporarily by restarting, which presumably cleared the data from the clipboard.

I haven't been able to reproduce this since.


Android GUI should convert spaces to hyphens in the Receive Code

When typing the Receive Code on the on-screen keyboard on an android system the GUI should convert spaces automatically hyphens. This way one could avoid shifting the keyboard layout to special character input after each word. The current GUI v1.4.1 doesn't support this.

I understand the frustration, but I'm hesitant to just mutate/edit user input like that. How is someone supposed to know that spaces get replaced with hypens?
I probably won't do this, but who knows, maybe.

I can understand why you would not want to fix it. Maybe I only have an issue with this because on the sending side where I ran an older version of croc in debug mode, and I saw that if after 30 seconds it reports no clients in the room, and that seemed to be a reason why I could not receive anything with my android client. The current version of croc seems to check every second for incoming bytes. So, if the user has plenty of time to enter the Receive Code, this can remain unfixed.

Since it's possible to specify your own receive code when sending on the command line I will also support specifying your own when sending using this too. That way the user can specify whatever they want.
I'm closing this, as #13 is the way I'll handle this.


NewBie here

Hi,
Does any one could give me a sample search, display and get location info.
Maybe this will help for the other newbie's.
Thanks.

I'm not sure what you are asking for? Can you clarify please?


Some emotes are not showing up correctly

Some emotes are not showing up correctly, the default skin is present instead of the custom one.
We have a custom FeelsBadMan, FeelsGoodMan and monkaS from FFZ added to the channel (sodapoppin) and it shows the default FeelsBadMan, FeelsGoodMan and monkaS.
I would understand the issue with FeelsBadMan and FeelsGoodMan cause they are global BTTV emotes, but monkaS is not global and there is no other monkaS added on BTTV to the channel, just the one we have on FFZ.
Thank you
ps.: I can see the custom emotes using the normal twitch chat (with FFZ and FFZ:AP or FFZ and BTTV installed), but cannot see them in chatterino.

Are you seeing the bttv emotes by chance?

Yes and no, like monkaS is not added, nor a global BTTV emote, it is only added as a custom FFZ emote, but the default monkaS is showing.
I see the default FeelsBadMan and FeelsGoodMan instead of the custom FFZ emote that is added to the channel.
(Using the latest beta build as of right now)

here's your monkas not being added as bttv emote

I did not even see that, I went through the list like 3 times. Thank you. Then that part of the problem is solved.
The only other thing would be overwriting global emotes with the same name if there is a custom emote added to FFZ.

to make it work ffz emotes should be parsed first then, because bttv doesn't allow using names of the default emotes for custom emotes anyway

Is FFZ overwriting BTTV emotes documented behavior? If it's undefined, I don't think this should be "fixed"

the order is undocumented, but specified  here and it goes global bttv -> chbttv -> globalffz -> chffz
My opinion is that the order be chffz -> chbttv -> globalffz -> globalbttv
cause i think ffz is better than bttv, and bttv should mostly be used only for gif emotes and in that case you ought to not have any other emote with the same name

I was also looking for the documentation, but could not find it anywhere.
"chffz -> chbttv -> globalffz -> globalbttv" This change would be a +1 from me.

How does it behave in the web chat? Who overwrites who with default BTTV+FFZ?

You really can't set a "default order".
Some people use Chatterino, others use FFZ+ FFZ:AP, others use BTTV + FFZ, others use Chatty etc etc.
Unless there is a standard on how it should be ordered, it can differ from person to another.

thats why I propose the order and the reasoning for it, that is in my earlier comment 👌

I have BTTV and FFZ installed without the (FFZ without the addon pack) and the FFZ channel emotes overwrite the global BTTV emotes.

Shouldn't the original combination of addons (which is probably also most used by most people) dictate what overwrites what? I don't think that just because one addon is better than other it should be the one overwriting other.

Fixed in #1080


Base: Support dark mode in builtin pages & new project logo

I did a quick scale of the project logo from the website using Gimp, if there are specifically designed small copies of the logo - that would be better :)

Please use one of the round "avatar" logos instead, this looks just a little too wonky :sweat_smile:

The avatar logos look quite poor at such small sizes (16x16, 32x32) IMO.

Having said that, using such small sizes seems wrong to me - especially if using a high-resolution display. Hmm.

Updated :)


Make the PayloadBuilder configurable over the PayloadBuilder stack

Describe the feature
I'd like the possibility to inject some custom logic into the process of building a payload (I.E: adding a static transaction to the payload body).
Currently it seems like we pass EthPayloadBuilder or OptimismPayloadBuilder to the spawn_payload_builder_service function from outside making it impossible to overwrite its behaviour.l
For reference the custom payload builder example: https://github.com/paradigmxyz/reth/pull/6269
CC: @mattsse @rkrasiuk @Rjected
Additional context
No response

this should no longer be an issue with new node builder


feat: migrate master to main (#706)

fixes #706.
Build is failing since we migrated from master to main, because github actions still referred to master branch.

👍

:+1:


Caching

Something else to consider is for restic-browser to cache results when you explore the backup directory tree structure to view files.  At the moment, if you return to directories you have visited already (even going back up to parent directory), the reload of the files is just as slow as the first.  The delay is not trivial - at least for me and I'm working with a restic repo that is on a local disk.
It might need to be an option to enable or not, as some users may not want to cache the file listings and directory structure on disk where they are using your tool, for security/privacy reasons.  They would have to endure the lag when navigating to different directories.
I do love that switching between snapshots keeps the directory view on the same directory.  This is great when you need to restore a file from a particular directory, but not sure which snapshot to pull it from.  Very nice!  This is something that backintime does.  It is a great GUI backup/restore tool to take some inspiration from.
Damo.

That's a great idea. When caching the contents in memory, I think we don't even need an option to disable the cache, as no sensitive data is written to disk. I'll give this a try in the next days.
Also wasn't aware of https://github.com/bit-team/backintime. It looks really nice and is indeed something to get some inspiration from, as it serves a similar purpose.


SSR doesn't include semantic fonts

I'm submitting a ...

[X] bug report
[ ] feature request

Bug Report:
When running SSR, my mac is using Helvetica font and not Lato.

What is the expected behavior?

Lato and fonts be bundled in build.

Your environment:

Node version: Latest Stable.
Browser: Chrome
OS: OSX
Language/Platform/etc:

Hi @TheDolo, seems strange, because Lato is obtained from Google fonts and is requested on application init. I'll check this. Sorry for no updates for a long time, because I still can't refactor some parts rightly

I appreciate the effort, I'm still here using your boilerplate for a enterprise production app (don't you love API/Frontend separation?), and I am relying on you :) (no worries)!
Cheers!

Hi @TheDolo, the app uses Lato font from Semantic. Semantic gets the fonts from Google Fonts. So probably it was your bug. Can you reproduce it?

Sorry, forgot about this one!  Seems fixed, unable to reproduce.


fix(scheduler): allow Deployment "in progress" to be bypassed in case of errors or timeout

It is possible to get a Deployment into a state where it can not bring up pods. The API will think that means that the Deployment is still "in progress". The scenario around this mostly happens when the client connection (CLI) is lost and the API loses context.
This change brings in the ability to get past the "in progress" stop sign when the Deployment is found to have errors (image not found, limits are bad, etc) or it has been in that state for more than the overall deploy timout limit is
Fixes #706
Refs #785
Replaces #792
Testing Instructions

Create a Deis Cluster
`deis create --no-remote progress
deis pull deis/example-go -a progress
deis limits:set -c cmd=9999999 -a progress (this should fail)
deis config:set foo=bar -a progress (this should succeed)
deis limits -a progress (this should show Unlimited and not 999999999
k get po --namespace progress -o yaml | grep version should show version: v3
deis releases -a progress should have on mention of limits

Current coverage is 85.11% (diff: 44.06%)

Merging #978 into master will decrease coverage by 0.51%

@@             master       #978   diff @@
==========================================
  Files            28         28
  Lines          3119       3158    +39
  Methods           0          0
  Messages          0          0
  Branches        533        539     +6
==========================================
+ Hits           2671       2688    +17
- Misses          298        318    +20
- Partials        150        152     +2

Powered by Codecov. Last update a16aa8c...8cfc1ce


first commit

i added my details

@tharukia  contribute here https://github.com/Ishaan28malik/Get-Dev-Resources


pick_ik is 10x slower than bio_ik

I finally did some benchmarking thanks to @Robotawi's help, and unfortunately the results are not encouraging.
Turns out that pick_ik's use of MoveIt's RobotState::updateLinkTransforms() + RobotState::getGlobalLinkTransform() for forward kinematics is 10x slower than the caching mechanism applied in bio_ik -- and that contributes to basically all the slowdowns in the benchmark.
https://github.com/ros-planning/moveit2/blob/main/moveit_core/robot_state/src/robot_state.cpp#L377-L379
We should fix this by looking at the tricks employed by bio_ik and improving MoveIt's RobotState to contain these capabilities!
One key thing that will need to happen here if we enable caching in RobotState is we can't just reuse the same RobotState instance for all the FK function calls. Basically, each memetic thread and local gradient descent call should use its own state so that the caching actually pays off. We'll also need to copy over from bio_ik the notion of a "link schedule" where the perturbations we evaluate first should happen at the tip of the kinematic chain(s) to minimize link pose recomputes.

Permalink to the code you referenced: https://github.com/ros-planning/moveit2/blob/01bae77cddcbb23edd1f7ba3de5487393a0261c5/moveit_core/robot_state/src/robot_state.cpp#L377-L379


ability to add subroutes to already registered routes

What problem does this feature solve?
This feature solves lazy loading problems in big applications, where we don't even want all routes to be registered for unauthorized users.
What does the proposed API look like?
It could be based on named routes - only named route could have its children list extended.
router.addRoutes when called with 2 arguments (name, route[]), would seek for named route by name and add route[] to its children

duplicate of #1156

it's a duplicate of https://github.com/vuejs/vue-router/pull/2064


Retro Terminal Effect really slow in VM

Environment
Windows build number: [Version 10.0.19041.21]
Windows Terminal version (if applicable): 0.8.10091.0

Any other software? Running Windows Insider Preview Build within a virtual machine (4 cores at 4.20GHz, 16Gb RAM) on Hyper-V

Steps to reproduce
Activate flag "experimental.retroTerminalEffect":true
Expected behavior
Retro Terminal Effect is applied
Actual behavior
Retro Terminal Effect is indeed applied, but any terminal (powershell, debian, etc) with that flag activated becomes really slow (even just typing). Looking at task manager while typing some command, the CPU goes to near 100% usage on all 4 cores.
Setting the flag to false makes everything to work as usual.
Could it be caused by the fact it is running within a virtual machine? Or maybe because Hyper-V doesn't allow to use Physical GPU in the VM and it has to rely on CPU only to do the rendering?
The main system has the latest Windows Release Build, not the Insider Preview Build and I can't test the terminal outside the VM.

this option eats a lot of GPU resources 😥

Still present in Terminal version 1.5.10411.0

@Piruzzolo Yep. As noted above:

Graphics effects of all kinds are usually very slow when done by CPU software rendering, this has been true and universally known for decades. It doesn't have anything to do with Windows Terminal really, and the effect isn't enabled by default either. You can also pass a GPU through to the VM to mitigate this problem.

@Piruzzolo Yep. As noted above:

Graphics effects of all kinds are usually very slow when done by CPU software rendering, this has been true and universally known for decades. It doesn't have anything to do with Windows Terminal really, and the effect isn't enabled by default either. You can also pass a GPU through to the VM to mitigate this problem.

Yep, I'm now in GPU rendering and it's slow too. I think this shader is the problem. It may be simplified/optimized in some way

Yep, that is the shader responsible for retro effects. We'd be happy to review any PRs to help optimize the effect if you can find something 😄
Note that the biggest cause of slowdown while using shaders is the fact that we can't use differential drawing while shaders are enabled. Differential drawing lets us only update the parts of the screen that have changed from one frame to the next, and is a massive perf improvement for the Terminal. #7147 is the closest thing we have to tracking "re-enable differential drawing when pixel shaders are enabled".

Maybe it would be easier of we don't use shaders for this effect and use a CRT-like font and a proper background, instead. This retro effect is so common that It would make sense to someway hardcode it. Or maybe precompute the visual rendering per-character and show the bitmap as the user types.


editor not showing on front end

Hello
I' trying to use this plugin but I do not see the pencil in the front end and cannot edit the content block (although the content do show). I double checked the tags (scripts, framework extras and styles) and are all on place plus I added the component to the page.
And I see that for each content to be editable I have to add a component? I have approximately 10 content blocks on a single page and would like all to be editable... is that possible?
many thanks!

Problem solved!
I managed to see the editing controls on the front end... I just needed the appropriated CMS permissions as you clearly pointed out in the plugin documentation :)


Figure out folder structure for translations

We need to figure out URL scheme and folder organization for docs, which are tied together.
URL/file names will stay the same
That is, we don't try translating /start/my_file to /empieza/mi_archivo for example. It's a common convention in localization to use consistent URLs and it makes everything much easier to implement.
Proposed URL scheme
English URLs will still the same w/o language in the URL/file, e.g. /start. But English does still need to show up in the language toggle.
Translations will start with /<lang> in their URL, e.g. /es/start and /fr/run. Everything after in the URL will be the same. Each language will have a full copy of the normal documentation but translated, and excluding API docs.
To communicate the language information to the docs app, we could reuse _package.json from https://github.com/Qiskit/docs/issues/8? Or add _language.json? Whatever makes the most sense for the application.
{"code": "es", "name": "Spanish"}

{"code": "zh-TW", "name": "Chinese (traditional)"}

Similar to how version toggling works, changing the language via the language toggle would change which top-level language folder is loaded (or English). It changes the language setting for the entire Docs app.
Locales vs languages
In qiskit.org, we had a concept of locales: the combination of language and region, e.g. es_UN for Spanish universal. The region part is useful to do things like show currencies and times/dates differently.
But in practice, we only had one locale per language, except for Chinese having both simplified and traditional.
Given the nature of the Qiskit documentation, I propose that we simplify and only use langauge codes like /es and /fr, without locales for every language but Chinese. It seems unlikely that we'll have the bandwidth to differentiate by locale. We didn't have the bandwidth before. It also doesn't seem super critical.
Chinese would be zh-CN (simplified) and zh-TW (traditional), though.
We could always add locales in the future to the other languages. We could set up redirects from /es/ to /es-UN/, for example.
FYI: how to integrate with Crowdin
Crowdin exports the folders with the locale as the prefix, e.g. es-es/. I couldn't change this behavior via their language mapping mechanism, even though the docs suggest it should have worked. For all but Chinese, we'll post-process the folder after downloading translations to remove the locale portion from the folder.
_toc.json
This file controls the names of things in the left sidebar, and what URLs they take you to.
We should not change the URLs. But it makes sense to translate the page titles.
  "children": [
    {
      "title": "Introducción",
      "url": "/start"
    },

Won't translate API docs
We took this decision for qiskit.org and the translations team has continued to plan for that.
So, the URL scheme for API docs from https://github.com/Qiskit/docs/issues/8 is orthogonal to the URL scheme for historical API docs.
Still, we should account for the possibility of changing our mind. If so, the URL scheme could be:
/es/api/qiskit/utils
/es/api/qiskit/0.44/utils

Internal links handled by the docs app
With internal links, it's important that we take you to the correct language for the sibling file.
There are two ways of doing internal links:
/start/my_file
../start/my_file

The first style starting with / would always refer to the English version of the file; you'd need to use /es/start/my_file to get the Spanish version. Or we'd need to have the docs app interpret the URL differently.
I originally proposed banning the first style and always using relative links, but we decided in https://github.com/Qiskit/documentation/issues/532 to instead have the docs app correctly set up internal links.
Note that links to /api should always point to English since there are no translated API docs.
Anchor links
Normally, we link to headers for anchors with internal links, i.e. #my-header section of a URL. That works because the docs app automatically assigns an HTML ID to headers, like My Header becoming my-header.
But when the headers are translated, My Header would now become Mi Cabecera, so #mi-cabecera. It would be very finicky if we expected translators to change all of these URL anchors for each language.
Instead, I think we do want something like https://github.com/Qiskit/documentation/issues/185 so that we can always use the same anchor regardless of the language. We'd ban using anchors from headers (except API docs).
How to keep files in sync
We'll use the Crowdin GitHub Action to handle a) uploading changes to the source docs, and b) downloading updated translations.
I propose using the GitHub action rather than Crowdin's GitHub integration in the app itself because it allows us more precise control over the behavior. The Crowdin Integration will open up a PR every time there is a new translation, for example, which is noisy. Instead, by using the GitHub action, we can batch changes to e.g. run once every week.
See https://github.com/Qiskit/documentation/pull/541 for how this implemented, including the different schedules we did for uploading English sources vs. downloading translations weekly.
Translations live in this repository
It's useful for the translations to live in Qiskit/documentation because it simplifies the setup. For example, it makes it easier for us to synchronize these open source docs with the closed source infrastructure that deploys this all to ibm.com. We also don't need to duplicate config and tooling like our link checker.
The major concern with translations living here would be if it's too noisy because of lots of PRs to update the translations. That is where batching is important (see "How to keep files in sync"). Rather than a PR for every translation, we'll only pull in translations e.g. once a week.

Thank you so much, Eric for writing this up. This is AMAZING!!! ✨
But, here are my thoughts --

URL/file names will stay the same

I agree

But in practice, we only had one locale per language.
Given the nature of the Qiskit documentation, I propose that we simplify and only use langauge codes like /sp and /fr, without locales. It seems unlikely that we'll have the bandwidth to differentiate by locale. We didn't have the bandwidth before. It also doesn't seem super critical.

Yes, it's true that we have only one locale per language except for  Simplified Chinese and Traditional Chinese. Spanish and Portuguese also had translations in 2 different locals which we later merged it and called Spanish, United and Portuguese, United. We also combined the teams for Bengali too. So, in cases like Chinese, when we are not able to combine the locales, We might want to keep the locales. But having a redirect option is a good option.

But English does need to show up in the language toggle.

Can you please clarify this? I think we do need English in the toggle to toggle back from, let's say, Japanese docs.

Ban absolute internal links?

We currently change it to <language>/rest-of-the-link in Crowdin when we translate

Anchor links

Good point!

How to keep files in sync?

This used be an issue with qiskit.org docs where the translations after a release would be outdated or have partially completed translations. I remember @mtreinish suggesting long time back to have a docs freeze or so, a week prior to the actual release so that (volunteers/professional) translators would have enough time to get the updated docs translated. So, this would be my very first suggestion.
If we are not able to have a docs freeze before actual release, then we might end up with having outdated or partially translated docs.

Closing this as completed, after discussing the design with @SooluThomas and @axelhzf. Axel thinks we'll likely want to use _language.json, but that can be finalized later. The overall architecture is approved and it's implemented in https://github.com/Qiskit/documentation/pull/541.
Refer to the epic https://github.com/Qiskit/documentation/issues/476 for follow up changes to get translations to production.


Always include Active and Pending Timestamps with Network Data.

Current coverage is 70.83% (diff: 50.00%)

Merging #1224 into master will increase coverage by 0.06%

@@             master      #1224   diff @@
==========================================
  Files           129        129
  Lines         19119      19123     +4
  Methods        2673       2673
  Messages          0          0
  Branches       2327       2327
==========================================
+ Hits          13530      13545    +15
+ Misses         4718       4701    -17
- Partials        871        877     +6

Powered by Codecov. Last update 61138b6...745576f

Current coverage is 70.83% (diff: 50.00%)

Merging #1224 into master will increase coverage by 0.06%

@@             master      #1224   diff @@
==========================================
  Files           129        129
  Lines         19119      19123     +4
  Methods        2673       2673
  Messages          0          0
  Branches       2327       2327
==========================================
+ Hits          13530      13545    +15
+ Misses         4718       4701    -17
- Partials        871        877     +6

Powered by Codecov. Last update 61138b6...745576f


Design proposal in componette footer: author's avatar resolution

Since people have great resolution on their desktops, can we make also the resolution bigger in these avatars?

What do you suggest? Please, don't forget about 1024px resoluition ;-)

I suggest make the resolution of each avatar twice as big (not the size! - the resolution). Don't you see the how blurry it is on the given screenshot? :)

Oh, I get it. Well, there's a blur effect on images. Should I drop it? xD

Aha! Oh boy. :D Yes.

I dont line the blur (either) 😀😉


sprite can't use for a container?

if i add a graphics to a sprite  i can't get correct width
let sprite =  new Sprite()
let gp:Graphics = new Graphics;
gp.beginFill(0x134534);
gp.drawRoundedRect(0,0,100,100,5);
gp.endFill();
sprite.addChild(gp);
console.log('width:',sprite.width)  --> width: 1
means sprite can't use for a container?
thx

Closing as I think this has been answered :)


DataCollator stopped working because there is no more  token

I am following along the medium article ... but the MyDataCollator class now barfs because there is no more  token in the additional_special_tokens of the processor.
Dropping the whole image part from it then causes this error during training
File ~/.cache/pypoetry/virtualenvs/fine-tune-idefics-vision-language-model-N0GBJh3_-py3.12/lib/python3.12/site-packages/transformers/trainer.py:3704, in Trainer.compute_loss(self, model, inputs, return_outputs, num_items_in_batch)
3702 else:
3703     if isinstance(outputs, dict) and "loss" not in outputs:
-> 3704         raise ValueError(
3705             "The model did not return a loss from the inputs, only the following keys: "
3706             f"{','.join(outputs.keys())}. For reference, the inputs it received are {','.join(inputs.keys())}."
3707         )
3708     # We don't use .loss here since the model may return tuples instead of ModelOutput.
3709     loss = outputs["loss"] if isinstance(outputs, dict) else outputs[0]
ValueError: The model did not return a loss from the inputs, only the following keys: logits,past_key_values,image_hidden_states. For reference, the inputs it received are input_ids,attention_mask,pixel_values,pixel_attention_mask.

After digging around I came up with this collator. Seems like the image token now lives in tokenizer.added_token_decoder
`import random
class MyDataCollator:
def init(self, processor):
self.processor = processor
self.image_token_id = 32001 # check processor.tokenizer what the id for image is
def __call__(self, examples):
    texts = []
    images = []
    for example in examples:
        image = example["image"]
        question = example["query"]
        answer = random.choice(example["answers"])
        messages = [
            {
                "role": "user",
                "content": [
                    {"type": "text", "text": "Answer briefly."},
                    {"type": "image"},
                    {"type": "text", "text": question}
                ]
            },
            {
                "role": "assistant",
                "content": [
                    {"type": "text", "text": answer}
                ]
            }
        ]
        text = processor.apply_chat_template(messages, add_generation_prompt=False)
        texts.append(text.strip())
        images.append([image])

    batch = processor(text=texts, images=images, return_tensors="pt", padding=True)

    labels = batch["input_ids"].clone()
    labels[labels == processor.tokenizer.pad_token_id] = self.image_token_id
    batch["labels"] = labels

    return batch

data_collator = MyDataCollator(processor)`

I finetuned it with qlora, and it successfully trained and saved, but when testing, I received the wrong result. Did you face the same problem? And do you know the reason? Thank you.
Here is my code for testing
processor = AutoProcessor.from_pretrained(
"HuggingFaceM4/idefics2-8b"
)
bnb_config = BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype=torch.float16
)
with torch.cuda.device(0):
model = Idefics2ForConditionalGeneration.from_pretrained(
model_path,
torch_dtype=torch.float16,
quantization_config=bnb_config,
).to(DEVICE)
model.eval()
test_eg = eval_dataset[0]
image = test_eg["image"]
query = test_eg["query"]
messages = [
{
"role": "user",
"content": [
{"type": "text", "text": "Answer briefly."},
{"type": "image"},
{"type": "text", "text": query}
]
}
]
print("query", query)
print("answer", test_eg["answers"])
text = processor.apply_chat_template(messages, add_generation_prompt=True)
inputs = processor(text=[text.strip()], images=[image], return_tensors="pt", padding=True)
generated_ids = model.generate(**inputs, max_new_tokens=64)
generated_texts = processor.batch_decode(generated_ids[:, inputs["input_ids"].size(1):], skip_special_tokens=True)
print("generated_texts", generated_texts)
Here is my result

@wirtsi

Thank you for your quick response ^^ I'll try it
could I ask about the parameters you used for the TrainingArguments and Trainer in your training setup?

Sure .. happy to help :) ... batch_size 3 works for 20GB RAM on GPU
training_args = TrainingArguments(
    output_dir="IDEFICS3_DocVQA",
    learning_rate=2e-4,
    fp16=True,
    per_device_train_batch_size=3,
    per_device_eval_batch_size=3,
    gradient_accumulation_steps=8,
    dataloader_pin_memory=False,
    save_total_limit=3,
    evaluation_strategy="steps",
    save_strategy="steps",
    eval_steps=25,
    save_steps=25,
    max_steps=1000,
    logging_steps=5,
    remove_unused_columns=False,
    push_to_hub=False,
    label_names=["labels"],
    load_best_model_at_end=True,
    report_to="none",
    optim="paged_adamw_8bit",
)

Thank you very much


No configuration tab for alerts trigger creation. Also Alerts are not working

No configuration tab for alerts trigger creation. Also Alerts are not working

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 03a2acba-a3c1-cadc-4448-c608a712881b
Version Independent ID: 54fafa9f-0b1d-46eb-f04b-85b3d314f44e
Content: Create and view permission analytics triggers in Permissions Management - Microsoft Entra
Content Source: articles/active-directory/cloud-infrastructure-entitlement-management/product-permission-analytics.md
Service: active-directory
Sub-service: ciem
GitHub Login: @jenniferf-skc
Microsoft Alias: jfields

@sneha-joy
Thanks for your feedback! We will investigate and update as appropriate.

@sneha-joy
Thank you for your feedback!
Since this issue isn't directly related to improving our docs, and to gain a better understanding of your issue, I'd recommend working closer with our support team via an [Azure support request] (https://docs.microsoft.com/en-us/azure/azure-portal/supportability/how-to-create-azure-support-request). Or you can leverage our Q&A forum by posting your issue there so our community, and MVPs can further assist you in troubleshooting this issue or finding potential workarounds.
[Teams Q&A forum] (https://docs.microsoft.com/en-us/answers/topics/46488/office-teams-windows-itpro.html) for technical questions about the configuration and administration of Microsoft Teams on Windows.
[Microsoft Teams Community forum] (https://answers.microsoft.com/en-us/msteams/forum?sort=LastReplyDate&dir=Desc&tab=All&status=all&mod=&modAge=&advFil=&postedAfter=&postedBefore=&threadType=All&isFilterExpanded=false&page=1)
Thank you for your time and patience throughout this issue.


track_id not persistent

iTunes track_id does not remain persistent.  Any changes to your iTunes library, such and changing any metadata may very well cause the track_id to change.  I had this happen to me.  Only the persistent_id field remains unchanged no matter what you do to the library.  This can result in errant behavior if one is relying on the track_id to never change for a particular track.
Is there a specific reason the persistent_id is not being used to build the dictionaries/lists?

After further investigating this issue, it appears whenever iTunes detects any changes that have been made to a 'Track' (i.e. Year, track number, album name, composer) metadata the entire iTunes Library.xml file is written back to disk and that previous 'track_id' is different for that track.  Only the 'persistent_id' is consistent across any changes or deletions.  Therefore, for anyone using this library who needs to be able to consistently refer to the same track, regardless of any updates made within the iTunes application, you will need to use the 'peristent_id' field.
I will see what I can do to make the 'Tracks' dictionary use the 'persistent_id' field as the key rather than the 'track_id' field.  I discovered this after printing out hundreds of pages with track names and then find out the names no longer match up to a track_id after making a few changes within the iTunes library.  Expensive mistake!

I created a new variable right below 'self.songs' named 'self.byPID' and then at the end of the getSongs() function I added just below 'self.songs[int(trackid)] = s', 'self.byPID[s.persistent_id] = s' this will now create an additional dictionary 'byPID' that can be used to manage tracks by their 'persistent_id' rather than 'track_id', which can change at anytime.


[Feature Request]: Add "Osho" quote.

Is there an existing issue for this?

[X] I have searched the existing issues

Feature Description
Quote by osho.
Record

[X] I agree to follow this project's Code of Conduct
[X] I want to work on this issue
[X] I'm willing to provide further clarification or assistance if needed.

@JayShukla8 Please assign me this issue under hacktoberfest.

done!


Support HTTP2 ingress.kubernetes.io/secure-backends: "true"

I am considering migrating from https://github.com/zlabjp/nghttpx-ingress-lb which has served me well as one of the first http2/grpc ingress controller.
From a security point of view, proxying a secure backend is critical for me as well as controlling HTTP2/HTTP1.1 protocols.
nghttpx-ingress-lb accomplished this with the following annotations .
apiVersion: extensions/v1beta1
kind: Ingress
metadata:
  name: gateway-https
  annotations:
    ingress.kubernetes.io/secure-backends: "true"
    ingress.zlab.co.jp/backend-config: '{"push": {"8013": {"proto": "http/1.1", "tls": true, "dns": true}}, "gateway": {"443": {"proto": "h2", "tls": true, "dns": true}}}'

Thanks for raising this issue.

ingress.kubernetes.io/secure-backends: "true"

Did you mean nginx.ingress.kubernetes.io/secure-backends: "true" ? See https://github.com/kubernetes/ingress-nginx/blob/master/docs/user-guide/nginx-configuration/annotations.md
For ingress.zlab.co.jp/backend-config:, contour already supports some of the aspects of this as an annotation on the service object, https://github.com/heptio/contour/blob/master/docs/annotations.md#contour-specific-service-annotations
I'm going to mark this as 0.7 to continue the discussion. I'm afraid I won't be able to look at it for the 0.6 cycle.

My understanding was that ingress.kubernetes.io/secure-backends was not nginx specific but ingress controller agnostics.
A vault operator example
kind: Ingress
apiVersion: extensions/v1beta1
metadata:
  name: vault
  namespace: default
  annotations:
    ingress.kubernetes.io/secure-backends: 'true'
    kubernetes.io/ingress.class: tectonic
spec:
  tls:
    - hosts:
        - vault.ingress.staging.core-os.net
      secretName: vault-server-ingress-tls
  rules:
    - host: vault.ingress.staging.core-os.net
      http:
        paths:
          - path: /
            backend:
              serviceName: example
              servicePort: 8200

Thanks. You're probably right, but dang those annotations are hard to
google.
On 23 July 2018 at 20:11, andrew<EMAIL_ADDRESS>wrote:

My understanding was that ingress.kubernetes.io/secure-backends
http://ingress.kubernetes.io/secure-backends was not nginx specific
but ingress controller agnostics.
A vault operator example
https://coreos.com/tectonic/docs/latest/vault-operator/user/ingress.html
kind: IngressapiVersion: extensions/v1beta1metadata:
name: vault
namespace: default
annotations:
ingress.kubernetes.io/secure-backends: 'true'
kubernetes.io/ingress.class: tectonicspec:
tls:
- hosts:
- vault.ingress.staging.core-os.net
secretName: vault-server-ingress-tls
rules:
- host: vault.ingress.staging.core-os.net
http:
paths:
- path: /
backend:
serviceName: example
servicePort: 8200
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/heptio/contour/issues/569#issuecomment-407008271, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AAAcA1_kGhaIQ8RNSf5aoyyLRFh20Berks5uJaFsgaJpZM4VZr24
.

I think it's nginx.ingress.kubernetes.io/backend-protocol: "HTTPS" now.

Not sure if this is still active or related but secure-backends has been deprecated and removed in current nginx-ingress versions.
See: https://github.com/kubernetes/ingress-nginx/issues/3416

@kskewes what's your recommendation for ensuring TLS between the ingress controller and the backend K8 services

Sorry I should have posted updated docs link too: https://github.com/kubernetes/ingress-nginx/blob/master/docs/user-guide/nginx-configuration/annotations.md#backend-protocol

Forgive me if I miss understood but it seems strange to use an annotation with your product that begins with Nginx. I was expecting ingress.kubernetes.io/secure-backends would be a vendor neutral choice

I'm just an end user and came across this by search about secure-backends. Hope haven't derailed issue :)

@kskewes hey no problem :) I was just hoping you had already guidance on this issue resolving this issue.
So what your saying is that the final annotation for contour should be something like contour.ingress.kubernetes.io/backend-protocol: "HTTPS" if I am correct?
When using nghttpx the syntax is kinda proprietor
ingress.zlab.co.jp/backend-config: '{"hello-srv": {"443": {"proto": "h2", "tls": true}}}'

No sorry. There are a few similar issues to this one. See https://github.com/heptio/contour/issues/406 etc .

@kskewes that is an excellent reference, I must have miss that related issue. I will continue to track that instead, thanks!

@andrewwebber what solution did you end up using to get this to proxy to a TLS upstream backend?

@bitsofinfo I have never found a solution to this problem with contour.
My solution is currently using nghttp ingress controller as it supports this use case.
https://github.com/zlabjp/nghttpx-ingress-lb

Closing as duplicate of #406 which has an assignee.


Uable to Install Rapid API Services

Type: Feature Request
It is saying that I cant Install "rapidapi.vscode-services" extension because it is not compatible with the current version of Visual Studio Code (version1.71.2)
VS Code version: Code 1.71.2 (74b1f979648cc44d385a2286793c226e611f59e7, 2022-09-14T21:03:37.738Z)
OS version: Windows_NT x64 10.0.26120
Modes:
Sandboxed: No

Thanks for creating this issue! It looks like you may be using an old version of VS Code, the latest stable release is 1.90.2. Please try upgrading to the latest version and checking whether this issue remains.
Happy Coding!


NiivueOptions syntax

Currently, the NiivueOptions for a Niivue widget can be accessed like so: nv.text_height.
However, this does not exactly mirror the method of accessing an option from a js Niivue object, which is like so: nv.opts.textHeight.
The naming difference (snake case vs camel case) is normal, however, the widget version is missing the "opts." text.
Ideally, a Niivue widget could have one of its options modified like so:
from ipyniivue import Niivue
nv = Niivue()
nv.opts.text_height = 0.05

@AnthonyAndroulakis, one option that we can look into is creating more "setter" and "getter" methods in the core NiiVue project.
So we could have something like nv.setTextHeight(newHeight), and nv.getTextHeight()

Good idea, this would be helpful.


Auto complete emoji list shows .png at the end of emoji name

Read our guide on bug reports here
Actual Behaviour
It is showing emoji name along with .png extension.

Expected Behaviour
It should only show emoji name.
Would you like to work on the issue?
Yes

@zulipbot claim-issue

@zulipbot claim-issue

Oh @Shailesh351 just saw that vishwesh has already claimed this issue, so you can checkout other unassigned issues.

@Sam1301 I was just going through code and found bug and remembered this issue
So i claimed it .. :sweat_smile:
I will checkout other unassigned issues..

cool, no problem.


TenantDatabaseAlreadyExistsException message issue

The reason does not display the database.
I receive

The code at the line 23 should come before parent::__construct(); so the reason message can display the database in the text.
Just to be noted. It is quite difficult to test with multi-db. The documentation must be clear on (Refresh the database, delete the created database,). I'm still stuck on this

Hey,
Nice catch! Can you submit a PR adding this line?
What do you mean by "difficult to test with multi-db"? The testing setup in boilerplate/sponsor docs works very well https://sponsors.tenancyforlaravel.com/frictionless-testing-setup
I will also be making some improvements to it, to clean up databases better and to use transactions inside the tenant DB for even better performance.