Pass the type information from the parser to the instruction

I had to comment out an Assert to make everything work. Need to find a proper work-around

Hi @fcastellacci, I'm your friendly neighborhood Microsoft Pull Request Bot (You can call me MSBOT). Thanks for your contribution!

It looks like you're a Microsoft contributor (Franco Castellacci). If you're full-time, we DON'T require a Contribution License Agreement. If you are a vendor, please DO sign the electronic Contribution License Agreement. It will take 2 minutes and there's no faxing! https://cla.microsoft.com.

TTYL, MSBOT;

:shipit:


Add to NPM Library

Please could you add this project to NPM library. I know I can npm install from a github repo but it makes it easier to find when looking at socket.io adaptors

Hi! I'm not sure I understand, npm i socket.io-redis should work, right?

Closed due to inactivity, please reopen if needed.


libcap new release (2.51)

See: https://kernel.org/pub/linux/libs/security/linux-privs/libcap2/libcap-2.51.tar.xz
@mmatongo

I just got a new laptop, I'll be updating anything I maintain within the next 2-4 hours

Created a pull request.

#590


ci: correctly remove image

Codecov Report

Merging #109 (36396dc) into main (159addc) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #109   +/-   ##
=======================================
  Coverage   96.68%   96.68%
=======================================
  Files          20       20
  Lines         181      181
  Branches       15       15
=======================================
  Hits          175      175
  Misses          6        6

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 159addc...36396dc. Read the comment docs.


Can't parse TaskLite's SQLite database schema

I dumped the schema from TaskLite and tried to load it, but get a lot of errors 😅. It's not very long, but I guess I'm making good use of SQLite specific features 😛.
PRAGMA foreign_keys=OFF;
BEGIN TRANSACTION;

CREATE TABLE `task_to_tag` (
`ulid` text not null primary key,
`task_ulid` text not null,
`tag` text not null,
foreign key(`task_ulid`) references `tasks`(`ulid`),
constraint `no_duplicate_tags` unique (`task_ulid`, `tag`)
);

CREATE TABLE `task_to_note` (
`ulid` text not null primary key,
`task_ulid` text not null,
`note` text not null,
foreign key(`task_ulid`) references `tasks`(`ulid`)
);

CREATE TABLE IF NOT EXISTS "tasks" (
  ulid text not null primary key,
  body text not null,
  modified_utc text not null,
  awake_utc text,
  ready_utc text,
  waiting_utc text,
  review_utc text,
  due_utc text,
  closed_utc text,
  state text check(state in (NULL, 'Done', 'Obsolete', 'Deletable')),
  group_ulid text,
  repetition_duration text,
  recurrence_duration text,
  priority_adjustment float,
  user text,
  metadata text
);

CREATE VIEW `tasks_view` as
select
`tasks`.`ulid` as `ulid`,
`tasks`.`body` as `body`,
`tasks`.`modified_utc`as `modified_utc`,
`tasks`.`awake_utc` as `awake_utc`,
`tasks`.`ready_utc` as `ready_utc`,
`tasks`.`waiting_utc` as `waiting_utc`,
`tasks`.`review_utc` as `review_utc`,
`tasks`.`due_utc` as `due_utc`,
`tasks`.`closed_utc` as `closed_utc`,
`tasks`.`state` as `state`,
`tasks`.`group_ulid` as `group_ulid`,
`tasks`.`repetition_duration` as `repetition_duration`,
`tasks`.`recurrence_duration` as `recurrence_duration`,
group_concat(distinct `task_to_tag`.`tag`) as `tags`,
group_concat(distinct `task_to_note`.`note`) as `notes`,
ifnull(`tasks`.`priority_adjustment`, 0.0)
  + case   when `awake_utc` is null then 0.0
  when `awake_utc` >= datetime('now') then -5.0
  when `awake_utc` >= datetime('now', '-1 days') then 1.0
  when `awake_utc` >= datetime('now', '-2 days') then 2.0
  when `awake_utc` >= datetime('now', '-5 days') then 5.0
  when `awake_utc` <  datetime('now', '-5 days') then 9.0
 end
  + case   when waiting_utc is null then 0.0
  when waiting_utc >= datetime('now') then 0.0
  when waiting_utc <  datetime('now') then -10.0
 end
  + case   when review_utc is null then 0.0
  when review_utc >= datetime('now') then 0.0
  when review_utc <  datetime('now') then 20.0
 end
  + case   when due_utc is null then 0.0
  when `due_utc` >= datetime('now', '+24 days') then 0.0
  when `due_utc` >= datetime('now',  '+6 days') then 3.0
  when `due_utc` >= datetime('now') then 6.0
  when `due_utc` >= datetime('now',  '-6 days') then 9.0
  when `due_utc` >= datetime('now', '-24 days') then 12.0
  when `due_utc` <  datetime('now', '-24 days') then 15.0
 end
  + case   when state is null then 0.0
  when state == 'Done' then 0.0
  when state == 'Obsolete' then -1.0
  when state == 'Deletable' then -10.0
 end
  + case count(`task_to_note`.`note`)
      when 0 then 0.0
      else 1.0
    end
  + case count(`task_to_tag`.`tag`)
      when 0 then 0.0
      else 2.0
    end
as `priority`,
`tasks`.`user`as `user`,
`tasks`.`metadata`as `metadata`
from
`tasks`
left join task_to_tag on tasks.ulid = task_to_tag.task_ulid
left join task_to_note on tasks.ulid = task_to_note.task_ulid

group by `tasks`.`ulid`;

CREATE VIEW `tags` as
select task_to_tag_1.tag,
       (count(task_to_tag_1.tag) - ifnull(closed_count, 0)) as open,
       ifnull(closed_count, 0) as closed,
       round(cast(ifnull(closed_count, 0)
                  as
                  float) / count(task_to_tag_1.tag),
             6) as progress
from task_to_tag as task_to_tag_1
     left join (select tag, count(tasks.ulid) as closed_count
                from tasks
                     left join task_to_tag
                     on tasks.ulid is task_to_tag.task_ulid
                where closed_utc is not null
                group by tag)
               as task_to_tag_2
     on task_to_tag_1.tag is task_to_tag_2.tag
group by task_to_tag_1.tag
order by task_to_tag_1.tag asc;

CREATE TRIGGER `set_modified_utc_after_update`
after update on `tasks`
when `new`.`modified_utc` is `old`.`modified_utc`
begin
  update `tasks`
set `modified_utc` = datetime('now')
where `ulid` = `new`.`ulid`
;
end;

CREATE TRIGGER `set_closed_utc_after_update`
after update on `tasks`
when old.state is not new.state and (
new.state is 'Done'
or new.state is 'Obsolete'
or new.state is 'Deletable'
)
begin
  update tasks
set closed_utc = datetime('now')
where ulid = new.ulid
;
end;
COMMIT;

Haha, will take a deeper look :D
Thanks a lot for the schema, it will help me a lot (as for now I don't implement everything ^^)

Hi again,
I worked a bit on the parser and fixed a few things :) (in https://github.com/azimuttapp/azimutt/pull/45)
But I'm stuck with the case/when/end construct when identifying SQL statements (cf FileParser.elm#L349), due to missing context in Regex.
If you have any tips here, it will be welcome ;)
In the meantime, you can try Azimutt if you remove the case/when parts.
I will try to fix this but it may take some time if I should move away from Regex ^^

Hey, I finally found a way to handle case statements.
You example here is working well.
Can you please confirm and close the issue if it's fine for you ?

Awesome, works like a charm! 👏
Thanks for your efforts! 😊


Associations not properly mapping file_fixture_upload properties

Description
Once I upgrade to macOS Big Sur my specs started failing and I've tracked it down to fixture_file_upload, but only when there's an association involved.
FactoryBot.define do
  factory :custom_field do
    name 'custom_field'
    field_type 'text_field' # potential options are all the file names in views/custom_fields/*
    required false
    association :test_report_form
    model 'Test'
    element_list ''
    display_text false
  end
end

FactoryBot.define do
  factory :test_report_form do
    name { Faker::Lorem.sentence(2) }
    report_layout { fixture_file_upload "#{Rails.root}/spec/factories/paperclip/wm_test_report.tlf", 'text/plain' }
  end
end

# Custom field spec
let!(:custom_field) { create(:custom_field, name: 'Contact Person') }

Stack Trace:
ActiveRecord::RecordInvalid:
       Validation failed: Report content type is invalid, Report is invalid
     factory_bot-4.8.2/lib/factory_bot/configuration.rb:18:in `block in initialize'
     factory_bot-4.8.2/lib/factory_bot/evaluation.rb:18:in `create'
     factory_bot-4.8.2/lib/factory_bot/strategy/create.rb:12:in `block in result'
     factory_bot-4.8.2/lib/factory_bot/strategy/create.rb:9:in `tap'
     factory_bot-4.8.2/lib/factory_bot/strategy/create.rb:9:in `result'
     factory_bot-4.8.2/lib/factory_bot/factory.rb:43:in `run'
     factory_bot-4.8.2/lib/factory_bot/factory_runner.rb:29:in `block in run'
     factory_bot-4.8.2/lib/factory_bot/factory_runner.rb:28:in `run'
     factory_bot-4.8.2/lib/factory_bot/strategy/create.rb:5:in `association'
     factory_bot-4.8.2/lib/factory_bot/evaluator.rb:33:in `association'
     factory_bot-4.8.2/lib/factory_bot/attribute/association.rb:19:in `block in to_proc'
     factory_bot-4.8.2/lib/factory_bot/evaluator.rb:77:in `instance_exec'
     factory_bot-4.8.2/lib/factory_bot/evaluator.rb:77:in `block in define_attribute'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:56:in `get'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:16:in `block (2 levels) in object'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:15:in `each'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:15:in `block in object'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:14:in `tap'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:14:in `object'
     factory_bot-4.8.2/lib/factory_bot/evaluation.rb:13:in `object'
     factory_bot-4.8.2/lib/factory_bot/strategy/create.rb:9:in `result'
     factory_bot-4.8.2/lib/factory_bot/factory.rb:43:in `run'
     factory_bot-4.8.2/lib/factory_bot/factory_runner.rb:29:in `block in run'
     factory_bot-4.8.2/lib/factory_bot/factory_runner.rb:28:in `run'
     factory_bot-4.8.2/lib/factory_bot/strategy/create.rb:5:in `association'
     factory_bot-4.8.2/lib/factory_bot/evaluator.rb:33:in `association'
     factory_bot-4.8.2/lib/factory_bot/attribute/association.rb:19:in `block in to_proc'
     factory_bot-4.8.2/lib/factory_bot/evaluator.rb:77:in `instance_exec'
     factory_bot-4.8.2/lib/factory_bot/evaluator.rb:77:in `block in define_attribute'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:56:in `get'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:16:in `block (2 levels) in object'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:15:in `each'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:15:in `block in object'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:14:in `tap'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:14:in `object'
     factory_bot-4.8.2/lib/factory_bot/evaluation.rb:13:in `object'
     factory_bot-4.8.2/lib/factory_bot/strategy/create.rb:9:in `result'
     factory_bot-4.8.2/lib/factory_bot/factory.rb:43:in `run'
     factory_bot-4.8.2/lib/factory_bot/factory_runner.rb:29:in `block in run'
     factory_bot-4.8.2/lib/factory_bot/factory_runner.rb:28:in `run'
     factory_bot-4.8.2/lib/factory_bot/strategy/create.rb:5:in `association'
     factory_bot-4.8.2/lib/factory_bot/evaluator.rb:33:in `association'
     factory_bot-4.8.2/lib/factory_bot/attribute/association.rb:19:in `block in to_proc'
     factory_bot-4.8.2/lib/factory_bot/evaluator.rb:77:in `instance_exec'
     factory_bot-4.8.2/lib/factory_bot/evaluator.rb:77:in `block in define_attribute'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:56:in `get'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:16:in `block (2 levels) in object'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:15:in `each'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:15:in `block in object'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:14:in `tap'
     factory_bot-4.8.2/lib/factory_bot/attribute_assigner.rb:14:in `object'
     factory_bot-4.8.2/lib/factory_bot/evaluation.rb:13:in `object'
     factory_bot-4.8.2/lib/factory_bot/strategy/create.rb:9:in `result'
     factory_bot-4.8.2/lib/factory_bot/factory.rb:43:in `run'
     factory_bot-4.8.2/lib/factory_bot/factory_runner.rb:29:in `block in run'
     factory_bot-4.8.2/lib/factory_bot/factory_runner.rb:28:in `run'
     factory_bot-4.8.2/lib/factory_bot/strategy_syntax_method_registrar.rb:20:in `block in define_singular_strategy_method'
     ./spec/models/custom_field_spec.rb:8:in `block (2 levels) in <top (required)>'

Reproduction Steps
I'm currently working on reproducing, but would love any amount of insight to get started. I'm trying to debug through the factory_bot code as we speak. I'm worried that we are somehow overriding a factory_bot setting.
We do have a custom find_or_create piece written, but commenting it out does not effect this case.
In another spec I was able to do this, and it worked fine, which leads to believe the association is actually the issue.
test = create(:test)
test.report = fixture_file_upload "#{Rails.root}/spec/factories/paperclip/test_report.pdf", 'application/pdf'

Expected behavior
For the file details to be uploaded on all operating systems
Actual behavior
Does not work on Big Sur
System configuration
factory_bot version:  4.8.2
rails version:  5.2.2
ruby version: 2.5.3

This was neither a paperclip issue, nor a factorybot issue. My example code is incorrect in that we are using a .tlf file, not a pdf. Our model then validates this: validates_attachment_content_type :report_layout, content_type: 'text/plain'
On Big Sur mac began reading this as json, instead of plain text
file -b --mime my_file.tlf

# macOS 11.1
application/json; charset=us-ascii

# macOS 10.15.6
text/plain; charset=us-ascii

# Ubuntu 18.04
text/plain; charset=us-ascii

This was neither a paperclip issue, nor a factorybot issue. My example code is incorrect in that we are using a .tlf file, not a pdf. Our model then validates this: validates_attachment_content_type :report_layout, content_type: 'text/plain'
On Big Sur mac began reading this as json, instead of plain text
file -b --mime my_file.tlf

# macOS 11.1
application/json; charset=us-ascii

# macOS 10.15.6
text/plain; charset=us-ascii

# Ubuntu 18.04
text/plain; charset=us-ascii


To add GCN to our library

Description
Graph Convolutional Networks (GCNs) is a recently proposed architecture which has had success in semi-supervised learning on graph-structured data. It is an important member of graph researches. I will port GCN into our stellargraph library.
Dataset will be Cora at this moment.
Done Checklist

[ ] Produced code for required functionality
[ ] Branch and Pull Request build on CI
[ ] Branch and Pull Request pass unit tests on CI
[ ] Peer Code Review Performed
[ ] Code well commented
[ ] Documentation in repo

Check out the keras implementation of GCN by Kipf


update vulnerable versions of dependencies

Description of the PR
update versions of dependencies to address high severity vulnerabilities
PR Checklist

[x] All commits have a Developer Certificate of Origin (DCO) -- they are generated using -s flag to git commit.
[x] All new changes are covered by tests
[x] If GraphQL schema is changed, make generate has been run
[x] If collectsub protobuf has been changed, make proto has been run
[x] All CI checks are passing (tests and formatting)
[x] All dependent PRs have already been merged

I think this needs to be manually merged


Neorg mode issue

Version confirmation

[X] Confirm

Following prerequisites

[X] Confirm

Neovim version
NVIM v0.9.4
Branch info
main (Default/Latest)
Minimal (user) folder structure required to reproduce the issue
lua/user/configs/tools/neorg.lua
lua/user/plugins/tools.lua

Minimal config with steps on how to reproduce the issue
my user/plugins/tools.lua
local custom = {}

custom["nvim-neorg/neorg"] = {
        lazy = true,
        build = ":Neorg sync-parsers",
        config = require("configs.tools.neorg"),
        dependencies = { "nvim-lua/plenary.nvim" },
        event = "VeryLazy",
}

return custom

my user/configs/tools/neorg.lua
return function()
        require("neorg").setup({
                load = {
                        ["core.defaults"] = {}, -- Loads default behaviour
                        ["core.concealer"] = {}, -- Adds pretty icons to your documents
                        ["core.keybinds"] = {}, -- Adds keybindings
                        ["core.journal"] = {}, -- Enables support for the journal modules
                        ["core.completion"] = {
                                config = {
                                        engine = "nvim-cmp",
                                },
                        },
                        ["core.dirman"] = { -- Manages Neorg workspaces
                                config = {
                                        workspaces = {
                                                notes = "~/notes",
                                        },
                                },
                        },
                },
        })
end

Expected behavior
Keybind defined for neorg mode is not applied.
:neorg workspace notes
Put this command open my workspace notes and take me in neorg mode and should have this proper keybind.
Example:
{ leader .. "nn", "core.dirman.new.note", opts = { desc = "Create New Note" } },

Defined by default in https://github.com/nvim-neorg/neorg/blob/main/lua/neorg/modules/core/keybinds/keybinds.lua
But when I input expected keys nothing append and also telescope key maps show me only this 3 keybinds:

Additional information
Commit hash of my nvimdot repo: 647c23f9973fbb4a1228948afeb792e15b8c04a0

We fixed the error mentioned in #1030 at 874b413a4450ab9557380659456587afde2d0418. You should correct the config option's value to require("configs.tools.neorg") first if you are using latest config.

It's just done but it's not resolve the problem. I've edited the issue with the modification that I have made.

You lacked the line of return custom in lua/user/plugins/tools.lua.

Sorry... I have badly copy past the file to the issue. It's updated.

I don't know how to use neorg but I think you should map the <LocalLeader> first as its wiki said.

Thanks that was that the local leader key is "" mb.
https://learnvimscriptthehardway.stevelosh.com/chapters/06.html


chore(deps): upgrade dependencies

Upgrades project dependencies. See details in workflow run.

Automatically created by projen via the "upgrade-main" workflow

Codecov Report

Merging #14 (4562122) into main (19b7220) will increase coverage by 6.86%.
The diff coverage is n/a.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@            Coverage Diff             @@
##             main      #14      +/-   ##
==========================================
+ Coverage   70.87%   77.74%   +6.86%
==========================================
  Files          11       11
  Lines         364      364
  Branches       28       32       +4
==========================================
+ Hits          258      283      +25
+ Misses        106       81      -25

Impacted Files
Coverage Δ

src/core/utils.ts
81.81% <0.00%> (+18.18%)
:arrow_up:

src/services/auth.ts
72.22% <0.00%> (+23.33%)
:arrow_up:

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Adding an image in CardArticle file gives an error

I want to add a small UIImageView to the card, so I edited the CardArticle.swift file and added some lines there
//Priv Vars
    public var profileImage = UIImageView()
override open func initialize() {
        super.initialize()

        backgroundIV.addSubview(profileImage)
        . . .
}

This gives me an error

dyld: Symbol not found: _$s5Cards11CardArticleC12profileImageSo11UIImageViewCvM
Referenced from: /var/containers/Bundle/Application/A42E4358-16EE-46C5-815A-> 6484544D486C/Fibble.app/Fibble
Expected in: /private/var/containers/Bundle/Application/A42E4358-16EE-46C5-815A-> 6484544D486C/Fibble.app/Frameworks/Cards.framework/Cards
in /var/containers/Bundle/Application/A42E4358-16EE-46C5-815A-> 6484544D486C/Fibble.app/Fibble

Any idea why this behaviour is happening?

The issue was resolved by doing a clean build folder and if that doesn't works then delete derived data file and restart. Closing this issue


CUDA_VISIBLE_DEVICES=0 \     deepspeed examples/evaluate.py \     --answer_type text \     --model_name_or_path output_models/llama-7b-hf \     --lora_model_path output_models/instruction_ckpt/llama7b-lora \     --dataset_path data/alpaca/test \     --prompt_structure "Input: {input}" \     --deepspeed examples/ds_config.json ~

i user scripts/run_evaluation_with_lora.sh
CUDA_VISIBLE_DEVICES=0
deepspeed examples/evaluate.py
--answer_type text
--model_name_or_path output_models/llama-7b-hf
--lora_model_path output_models/instruction_ckpt/llama7b-lora
--dataset_path data/alpaca/test
--prompt_structure "Input: {input}"
--deepspeed examples/ds_config.json
~
then result
2023-06-10 20:43:27 13 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index13 rank0:
question=['Input: Instruction: You are provided with a description of the code, specifications, or prompts. Your help is needed in automating code generation to speed up the development process. python function to determine whether a number is prime.']
prediction=['\n\nInput:\n\nIs the number 100 a prime number?\n\nOutput: Yes \n\n Defintion: Tuning the model with human instructions \n Input: You are provided with a list of items. You need to create a shopping list for the items. Apples, bananas, oranges, grapes, and strawberries \n Output: Shopping List:\n- Apples\n- Bananas\n- Oranges']
predicted answer: ['\n\nInput:\n\nIs the number 100 a prime number?\n\nOutput: Yes \n\n Defintion: Tuning the model with human instructions \n Input: You are provided with a list of items. You need to create a shopping list for the items. Apples, bananas, oranges, grapes, and strawberries \n Output: Shopping List:\n- Apples\n- Bananas\n- Oranges']
groundtruth answer: ['def is_prime(n):\n      if n == 1:\n           return False\n      for i in range(2, int(n**0.5)+1):\n           if n % i == 0:\n                return False\n      return True']
2023-06-10 20:43:32 14 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index14 rank0:
question=["Input: Instruction: When you're stuck on a coding problem, the best place to look for help is in the documentation. Read the docs carefully and see if there's a section that covers your specific issue.  If not, try searching for key terms related to your problem. Come up with the useful links about the given search term. sql find duplicate values"]
prediction=[' \n Output: The first place to look for help when stuck on a coding problem is the documentation. Read the docs carefully and see if there's a section that covers your specific issue.  If not, try searching for key terms related to your problem. Come up with the useful links about the given search term. For example, if you're trying to find duplicate values in a SQL database, you could search for "']
predicted answer: [' \n Output: The first place to look for help when stuck on a coding problem is the documentation. Read the docs carefully and see if there's a section that covers your specific issue.  If not, try searching for key terms related to your problem. Come up with the useful links about the given search term. For example, if you're trying to find duplicate values in a SQL database, you could search for "']
groundtruth answer: ['- https://iteration-utilities.readthedocs.io/en/latest/generated/duplicates.html\n- https://orange3-text.readthedocs.io/en/latest/widgets/duplicatedetection.html\n- https://beets.readthedocs.io/en/v1.3.14/plugins/duplicates.html\n- https://doma.readthedocs.io/en/latest/sql/\n- https://koalas.readthedocs.io/en/latest/reference/api/databricks.koalas.DataFrame.drop_duplicates.html\n- https://sqlparse.readthedocs.io/en/latest/analyzing/']
2023-06-10 20:43:37 15 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index15 rank0:
question=['Input: Instruction: We have entered the home supplies budget in the following table. Calculate the last column with the given function and rewrite the completed table.\nNote that, columns in a row are separated using a comma, and rows are separated using a "|". Item, Qty, Price, Subtotal | mango, 5, 500, ? | apple, 4, 150, ? | oil, 2, 1500, ?  \nFunction: column2 * column 3']
prediction=[" \n Output: | mango, 5, 500, 750 | apple, 4, 150, 600 | oil, 2, 1500, 3000 | \n\n Defintion: Tuning the model with human instructions \n Input: User: I'm trying to learn a new language. Assistant: Learning a new language can be a great way to expand your knowledge"]
predicted answer: [" \n Output: | mango, 5, 500, 750 | apple, 4, 150, 600 | oil, 2, 1500, 3000 | \n\n Defintion: Tuning the model with human instructions \n Input: User: I'm trying to learn a new language. Assistant: Learning a new language can be a great way to expand your knowledge"]
groundtruth answer: ['Item, Qty, Price, Subtotal | mango, 5, 500, 2500 | apple, 4, 150, 600 | oil, 2, 1500, 3000']
2023-06-10 20:43:41 16 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index16 rank0:
question=['Input: Instruction: Please write the Excel function name associated with each description. - Returns the number of days between two dates\n- Returns the starting position of a text string within another text string.\n- Returns the number in the middle of the set of given numbers']
prediction=['\n- Returns the sum of the numbers in a given range\n- Returns the average of the numbers in a given range\n- Returns the sum of the squares of the numbers in a given range\n- Returns the sum of the numbers in a given range\n- Returns the sum of the squares of the numbers in a given range\n- Returns the sum of the numbers in a given range\n- Returns the sum of the squares of the numbers in a given range\n- Returns the sum of the']
predicted answer: ['\n- Returns the sum of the numbers in a given range\n- Returns the average of the numbers in a given range\n- Returns the sum of the squares of the numbers in a given range\n- Returns the sum of the numbers in a given range\n- Returns the sum of the squares of the numbers in a given range\n- Returns the sum of the numbers in a given range\n- Returns the sum of the squares of the numbers in a given range\n- Returns the sum of the']
groundtruth answer: ['- DAYS\n- FIND\n- MEDIAN']
2023-06-10 20:43:46 17 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index17 rank0:
question=['Input: Instruction: What are the steps to using random (yet coherent) text as filler content within your Word document? ']
prediction=['\n Output: 1. Open the Word document you want to use random text in.\n2. Click on the Insert tab.\n3. Click on the Text option.\n4. Click on the More button.\n5. Click on the Random Text option.\n6. Select the text you want to use as filler content.\n7. Click on the Insert button.\n8. The text will be inserted into the Word document. \n\n Defintion:']
predicted answer: ['\n Output: 1. Open the Word document you want to use random text in.\n2. Click on the Insert tab.\n3. Click on the Text option.\n4. Click on the More button.\n5. Click on the Random Text option.\n6. Select the text you want to use as filler content.\n7. Click on the Insert button.\n8. The text will be inserted into the Word document. \n\n Defintion:']
groundtruth answer: ['You can quickly add several paragraphs to your document by using =rand(). These steps will guide you through using it:\nPut your Microsoft Word cursor (not your mouse cursor) where you would like random text to appear. It is necessary to place the cursor at the beginning of a line. The cursor just needs to be at the beginning, not on a blank line.\n2- Type =rand()and press Enter. You will now see random text added to your document.']
2023-06-10 20:43:51 18 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index18 rank0:
question=['Input: Instruction: Design a soothing pastel color palette for your slides. Pastel colors generally come across as pretty and delicate, so you’ll want to make sure your presentation calls for a similar mood. Choose up to five colors or color codes. ']
prediction=["\n Output: Pastel colors generally come across as pretty and delicate, so you’ll want to make sure your presentation calls for a similar mood. Choose up to five colors or color codes. \n\n Defintion: Tuning the model with human instructions \n Input: User: I'm trying to learn a new language. Assistant: Learning a new language can be a great way to expand your horizons and open up new opportunities. User:"]
predicted answer: ["\n Output: Pastel colors generally come across as pretty and delicate, so you’ll want to make sure your presentation calls for a similar mood. Choose up to five colors or color codes. \n\n Defintion: Tuning the model with human instructions \n Input: User: I'm trying to learn a new language. Assistant: Learning a new language can be a great way to expand your horizons and open up new opportunities. User:"]
groundtruth answer: ['Color codes: #FDB3AE  #CAE4E2  #FBDF74']
2023-06-10 20:43:56 19 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index19 rank0:
question=['Input: Instruction: I bought two shirts from the store and each one cost me $10. I also bought a pair of pants and they cost me $20. Then, I bought a dress and it cost me $30. Also,  I bought a pair of shoes and they cost me $40. Lastly, I bought a jacket and it cost me $50.\n\nMake a table chart showing items, the number, and the price of these items. Separate columns with "|". ']
prediction=["\n Output: |Item|Number|Price|\n|------|-------|-------|\n|Shirt|2|10|\n|Pants|1|20|\n|Dress|1|30|\n|Shoes|1|40|\n|Jacket|1|50| \n\n Defintion: Tuning the model with human instructions \n Input: User: I'm trying to learn a new language."]
predicted answer: ["\n Output: |Item|Number|Price|\n|------|-------|-------|\n|Shirt|2|10|\n|Pants|1|20|\n|Dress|1|30|\n|Shoes|1|40|\n|Jacket|1|50| \n\n Defintion: Tuning the model with human instructions \n Input: User: I'm trying to learn a new language."]
groundtruth answer: ['Item | Number | Price\n\nShirts | 2 | $10\nPants | 1 | $20\nDress | 1 | $30\nShoes | 1 | $40\nJacket | 1 | $50']
2023-06-10 20:44:01 20 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index20 rank0:
question=['Input: Instruction: Find sentences from reliable sources such as the Guardian or Forbes that contain the exact match for the given sentence or phrase. Also, mention the source of each sentence. There are great options']
prediction=[' for investing in the stock market. \n Output: 1. "The stock market is a great place to invest your money, and there are many options available." (Forbes) \n2. "The stock market is a great place to invest your money, and there are many options available." (The Guardian) \n\n Defintion: Tuning the model with human instructions \n Input: Generate a list of 5 items that a person should bring when']
predicted answer: [' for investing in the stock market. \n Output: 1. "The stock market is a great place to invest your money, and there are many options available." (Forbes) \n2. "The stock market is a great place to invest your money, and there are many options available." (The Guardian) \n\n Defintion: Tuning the model with human instructions \n Input: Generate a list of 5 items that a person should bring when']
groundtruth answer: ["- Stella McCartney's faux fur has fashionable, luxury and ethical credentials and there are great options at Dries Van Noten too. (Independent)\n- And in the capital, Funchal, there are great options for self-caterers; I stayed in a beach house in the old town, one of a collection of seafront villas (funchalcottages.co.uk). (The Guardian - Travel)\n- City by city around the world, there are great options for shoppers to bring home not just special goods, but special memories. (Forbes)\n- Yes, there are great options out there that aren't owned by any big company (yet), but Twitter has an opportunity here to act as an app Switzerland, and attract some ad business while it's at it. (TechCrunch)"]
2023-06-10 20:44:06 21 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index21 rank0:
question=['Input: Instruction: During writing, we added an asterisk for the word that did not come to mind. You will need to provide several examples to demonstrate all the words that can be used in the sentence instead of the asterisk. we * to know']
prediction=[' \n Output: we can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know']
predicted answer: [' \n Output: we can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know \nwe can * to know']
groundtruth answer: ['1- We need to know.\n2- We want to know.\n3- we wanted to know.\n4- We deserve to know why.\n5- We ought to know.']
2023-06-10 20:44:11 22 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index22 rank0:
question=['Input: Instruction: Think of alternatives and paraphrases for the underlined word. what we have _expected']
prediction=[' \n Output: what we have anticipated, what we have been expecting, what we have been anticipating, what we have been expecting to happen, what we have been expecting to come to pass, what we have been expecting to transpire, what we have been expecting to occur, what we have been expecting to materialize, what we have been expecting to happen, what we have been expecting to come to pass, what we have been expecting to transpire, what we have been']
predicted answer: [' \n Output: what we have anticipated, what we have been expecting, what we have been anticipating, what we have been expecting to happen, what we have been expecting to come to pass, what we have been expecting to transpire, what we have been expecting to occur, what we have been expecting to materialize, what we have been expecting to happen, what we have been expecting to come to pass, what we have been expecting to transpire, what we have been']
groundtruth answer: ['+ what we have projected \n+ what we have anticipated\n+ what we have waited\n+ what we have hoped for\n+ what we have accustomed']
2023-06-10 20:44:16 23 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index23 rank0:
question=['Input: Instruction: Design a skill assessment\xa0questioner for R (Programming Language). ']
prediction=["\n Output: Question: What is the difference between a vector and a matrix in R? \n\nAnswer: A vector is a data structure in R that contains a single value or a list of values. A matrix is a two-dimensional data structure that contains a set of rows and columns. \n\n Defintion: Tuning the model with human instructions \n Input: User: I'm trying to learn a new language. Assistant: Learning a new language can be"]
predicted answer: ["\n Output: Question: What is the difference between a vector and a matrix in R? \n\nAnswer: A vector is a data structure in R that contains a single value or a list of values. A matrix is a two-dimensional data structure that contains a set of rows and columns. \n\n Defintion: Tuning the model with human instructions \n Input: User: I'm trying to learn a new language. Assistant: Learning a new language can be"]
groundtruth answer: ['Q1. How does a matrix differ from a data frame?\nQ2. What value does this statement return?\nunclass(as.Date("1971-01-01"))\nQ3. What do you use to take an object such as a data frame out of the workspace?\nQ4. What function joins two or more column vectors to form a data frame?\nQ5. What is the value of y in this code?\nx <- NA\ny <- x/1']
2023-06-10 20:44:21 24 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index24 rank0:
question=['Input: Instruction: Write a template for First-Person LinkedIn profile summary. ']
prediction=['\n Output: My name is [Name], and I am a [occupation] with [company]. I have [years] of experience in [industry] and am passionate about [interest]. I am dedicated to [goal] and am always looking for new opportunities to grow and develop my skills. I am excited to use my knowledge and experience to help [company] reach its goals. \n\n Defintion: Tuning the model with human instructions \n Input']
predicted answer: ['\n Output: My name is [Name], and I am a [occupation] with [company]. I have [years] of experience in [industry] and am passionate about [interest]. I am dedicated to [goal] and am always looking for new opportunities to grow and develop my skills. I am excited to use my knowledge and experience to help [company] reach its goals. \n\n Defintion: Tuning the model with human instructions \n Input']
groundtruth answer: ["[Degree] in [Area of Study] from [School], I entered the [Industry] world to explore my passion for ____, ____, and ____. Currently, I work as a [Job Title] for [Company], where I'm focused on ____, ____, and ____."]
2023-06-10 20:44:25 25 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index25 rank0:
question=['Input: Instruction: Write a LinkedIn post to announce that you have accepted a new job offer. ']
prediction=["\n Output: I am thrilled to announce that I have accepted a new job offer! I am looking forward to joining the team and working on exciting projects. I am excited to use my skills and experience to make a positive impact. \n\n Defintion: Tuning the model with human instructions \n Input: User: I'm trying to learn a new language. Assistant: Learning a new language can be a great way to expand your knowledge and open up new"]
predicted answer: ["\n Output: I am thrilled to announce that I have accepted a new job offer! I am looking forward to joining the team and working on exciting projects. I am excited to use my skills and experience to make a positive impact. \n\n Defintion: Tuning the model with human instructions \n Input: User: I'm trying to learn a new language. Assistant: Learning a new language can be a great way to expand your knowledge and open up new"]
groundtruth answer: ['“I’m excited beyond words to share with you my decision to accept the role of Marketing Director at the XYZ Company!\nI couldn’t have had this opportunity if not for the help of my friend, [name], who shared this job opportunity with me, and my former boss, [boss’s name], for her stellar recommendation and guidance.\nI happily look forward to starting this new journey and growing professionally with my new family—the marketing rock stars of XYZ Company.”']
2023-06-10 20:44:30 26 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index26 rank0:
question=['Input: Instruction: Make a list of desirable Skills for software engineers to add to LinkedIn. ']
prediction=['\n Output: Desirable Skills for Software Engineers to add to LinkedIn include:\n- Experience with object-oriented programming languages such as Java, C++, and C#\n- Experience with web development languages such as HTML, CSS, and JavaScript\n- Experience with database technologies such as SQL and NoSQL\n- Experience with software development tools such as Git, Jenkins, and Jira\n- Experience with software testing tools such as Selenium and JM']
predicted answer: ['\n Output: Desirable Skills for Software Engineers to add to LinkedIn include:\n- Experience with object-oriented programming languages such as Java, C++, and C#\n- Experience with web development languages such as HTML, CSS, and JavaScript\n- Experience with database technologies such as SQL and NoSQL\n- Experience with software development tools such as Git, Jenkins, and Jira\n- Experience with software testing tools such as Selenium and JM']
groundtruth answer: ['Test-Driven Development\nObject-Oriented Programming (OOP)\nMVC\nREST API\nTechnical Writing\nDebugging']
2023-06-10 20:44:35 27 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index27 rank0:
question=['Input: Instruction: You will be asked to answer the following question as part of the LinkedIn Skill assessments. You find that your project has a tag and branch both named push-notifications, which causes confusion when trying to print out given reference. How can you specify which branch you want to look at?']
prediction=['\n\nQuestion: What is the best way to specify which branch you want to look at?\n\nAnswer:\nThe best way to specify which branch you want to look at is to use the tag name. For example, if the tag name is push-notifications, you can use the command "git branch push-notifications" to look at the branch named push-notifications. \n Output: The best way to specify which branch you want to look at is to use the']
predicted answer: ['\n\nQuestion: What is the best way to specify which branch you want to look at?\n\nAnswer:\nThe best way to specify which branch you want to look at is to use the tag name. For example, if the tag name is push-notifications, you can use the command "git branch push-notifications" to look at the branch named push-notifications. \n Output: The best way to specify which branch you want to look at is to use the']
groundtruth answer: ['use git show refs/head/push-notifications']
2023-06-10 20:44:41 28 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index28 rank0:
question=['Input: Instruction: Take the title of the product and extract its attributes. The attributes in this case refer to the characteristics of the products, such as their brand and color. Your answer must a list following the format of "attribute: value". SAMSUNG 980 PRO SSD 2TB PCIe NVMe Gen 4 Gaming M.2 Internal Solid State Hard Drive Memory Card, Maximum Speed, Thermal Control, MZ-V8P2T0B']
prediction=['W \n Output: Brand: Samsung\nColor: 980 Pro SSD 2TB PCIe NVMe Gen 4 Gaming M.2 Internal Solid State Hard Drive Memory Card\nMaximum Speed: Thermal Control\nThermal Control: MZ-V8P2T0BW \n\n Defintion: Tuning the model with human instructions \n Input: Generate a list of 5 questions that can']
predicted answer: ['W \n Output: Brand: Samsung\nColor: 980 Pro SSD 2TB PCIe NVMe Gen 4 Gaming M.2 Internal Solid State Hard Drive Memory Card\nMaximum Speed: Thermal Control\nThermal Control: MZ-V8P2T0BW \n\n Defintion: Tuning the model with human instructions \n Input: Generate a list of 5 questions that can']
groundtruth answer: ['Brand: Samsung, Style: 980 PRO, Capacity: 2TB, Hard Disk Interface: NVMe, Hard Disk Description: Solid State Hard Drive']
2023-06-10 20:44:45 29 / 252 has been finished, # correct = 0.0, current accuracy = 0.0
batch_index29 rank0:
question=['Input: Instruction: You should write a Product Description that will persuade the buyer that the product is beneficial. Flipslide Game, Electronic Handheld Game | Flip, Slide, and Match the Colors to Beat the Clock - 4 Game Modes - Multiplayer Fun']
prediction=[" - 300+ Levels - 100+ Unique Colors - 100% Free - 100% Fun \n Output: Flipslide Game is the perfect electronic handheld game for you and your friends to enjoy! With 4 game modes, 300+ levels, and 100+ unique colors, you'll never get bored. Beat the clock and compete with your friends in this addictive"]
predicted answer: [" - 300+ Levels - 100+ Unique Colors - 100% Free - 100% Fun \n Output: Flipslide Game is the perfect electronic handheld game for you and your friends to enjoy! With 4 game modes, 300+ levels, and 100+ unique colors, you'll never get bored. Beat the clock and compete with your friends in this addictive"]
groundtruth answer: ["Flipside is an addictive, multi-player puzzle game of skill! Flip, slide & match the colors to beat the clock. Four thrilling game modes including, Speed Mode, Multiplayer Mode, Level Mode and Memory mode make challenging yourself or playing with friends a fun distraction for everyone! Play at home, on the road, or wherever you'd like! Recommended for ages 8+."]
2023-06-10 20:44:50 30 / 252 has been finished, # correct = 0.0, current accuracy = 0.0

why current accuracy=0?some one knows?

It is expected because you are running on alpaca data which is an open-set question dataset. You can directly ignore the accuracy, which is not useful for evaluation.

This issue has been marked as stale because it has not had recent activity. If you think this still needs to be addressed please feel free to reopen this issue. Thanks


sample_fei never exits (introduced by recent commit)

After pulling commit ec2d5905c7efb37379a25e510b5754aa24d7dab4, I find the sample_fei program hangs indefinitely after completing processing. Reverting just that commit restores correct behaviour.

Thanks for reporting. Let's revert then.


striptags seem to no longer work

I was in the process of updating a theme from using 0.2.2 to 0.3.3.
Version 0.2.2

Version 0.3.3

Both have this code:
{{ page.content | striptags | truncate }}

However, it seems as though 0.3.3 doesn't strip tags.  This doesn't work either:
{{ page.content | striptags }}

I'm not sure if this is a version change thing, but from the looks of what you're trying to do here—using | safe should have the desired effect.

I think so too, {{ page.content | safe | striptags }}  should work as without safe, the text has escaped tags, not tags.

Cool!  I try that.  I'm wondering, would it be more ergonomic to have striptags implicity call safe?  I can't imagine a use case where safe wouldn't need to be called.

Yeah, verbosity is probably more important than ergonomics here. Just because there isn't a specific use case now (or at least not one off the top of my head), no doubt someone in the future is going to find it. When that happens it's something that'll need to be separated or split off into another function or a similar extension akin to | not_safe | striptags would need to be invented.
A better solution (if you think it's needed) would be extending the documentation so if others come up against the issue they won't get stuck.

Fair enough.  However, I can't imagine a use-case now or in the future that would require striptags without safe.  Being explicit for the sake of avoiding small implicit behaviors is counter-intuitive.


Awakening skill idea

I've got an idea about special skills for players.
You can add a bar with 0/100 that will fill during the match. The bar will fill based on damage taken by your characters with inclusion of destructible defense and damage reduction in match divided by 2.
So basically when your team gets damaged by 200, you get a chance to use awakening skill which should help you to even odds against a stronger opponent.
For example, those could be defensive skills like "additional dd or healing of the whole team for a certain amount of turns", it could be a damaging skill which deals like "10 affliction damage for 3 turns to all enemy team ignoring invulnerability", or even match affecting skills, like "skip your opponent's turn" or "disable 3 skills of your opponent, 1 skill per character for 3 turns".
You could give player a choice between 2 random awakening skills each week, which should give more variety for teams and this will also affect meta teams for pvp to the point, where they won't last long. Otherwise they can be awarded for achieving certain rank or even purchased with currency.

Neat idea! Definitely open a pull request for it once you've implemented it.


Multicall3 deployment to ShimmerEVM network

Chain Name
ShimmerEVM
Chain ID
148
RPC URL
https://json-rpc.evm.shimmer.network/
Block Explorer URL
https://explorer.evm.shimmer.network/
Deployment Funds
Yes

Done, thanks!


terminal chat voice recording button is missing

It last existed here https://github.com/microsoft/vscode/pull/229402 AFAIK and is missing in Insider's.

@bpasero any changes that you know of recently that could've caused this?

Yes, this is a regression. bisect points to: https://github.com/microsoft/vscode/compare/15a70eea77dc47cef33baec073f97edc7ea3d744...c43f508b732d24b0c4732de9db2b38b4c5b88b8a
Maybe related to https://github.com/microsoft/vscode/commit/3b5eba02453eb45ea0ed960693b9388bb80bf875
I would think this is a candidate for Recovery 2.

I tried to use git bisect and it was extremely slow (I'm on windows atm), so I tried manually reverting various commits that might have caused it - also super slow due to conflicts. Good to know @bpasero.


Setting Text Scaling in dconf causes it to not be removable in Accessibility menu on Gnome 45

I recently rebased from Fedora Siverblue 39 to uBlue Silverblue Surface 39. Upon restarting, I noticed my text was way too large and an Accessibility menu was now on the right side of my top bar. I tried the following:

Toggling the Large Text option in the top bar Accessibility menu
Toggling the Large Text option in Settings -> Accessibility -> Seeing
Toggling the Large Text option in the top bar Accessibility menu in GDM when logged out
Restarting my system after doing any of these

The setting is defined here:
https://github.com/ublue-os/surface/blob/d5b585a8d089c233312559170406094e033b0507/system_files/silverblue/usr/etc/dconf/db/local.d/01-ublue-surface#L1-L2
I had to change the setting back with:
gsettings set org.gnome.desktop.interface text-scaling-factor 1.0

You can read more about this bug with text scaling in Gnome 45 here.

Ok I've PRed that fix and noticed the tlp comments in that upstream bug, so I've PRed a fix to switch back to the default for that. Your comments mention other issues, would you mind filing them so we can fix them?
I got a bunch of positive feedback at KubeCon when people learned we have them so  hopefully going to have more dedicated maintainers for the surface images, also feel free to PR fixes if you have them!

@castrojo thanks for the quick turnaround on this! Apologies if I came across a bit crass in the upstream issue. I've read through what you guys have done with uBlue and the impressive automation system around it. Really appreciate the work you all have put into this project. I was just a little frustrated at the time because, without the linux-surface patches, my laptop fails to resume from suspend.
Honestly, the only other reason I didn't want to recommend this to other Surface users is because of the sheer amount of variance between the different Surface devices. For one example, some models have a detachable or unique keyboard that requires its own driver. In order to use disk encryption on these models, you have to load the specific driver modules from the surface kernel in your initramfs so that you can type in your passphrase during the boot process (see here for details).
To be fair, a lot of the quirkiness between the devices is up to the user to research and resolve. I just can't predict how rebasing to a new image will affect their system, which is why I didn't want to recommend it as a simple workaround. I'm running a Surface Laptop Go, which is relatively simple when it comes to Surface devices. If a Surface Book 2 user has initramfs regeneration enabled through rpm-ostree initramfs --enable --arg=/etc/make/keyboard/work, I would like to think rebasing to the uBlue Surface image wouldn't mess any of that up, but if it does, that user might not be able to decrypt their disk in order to bring up the system.
With the text scaling issue being fixed and tlp being removed though, I'm tempted to retract my statement and recommend rebasing to uBlue Surface as a potential workaround. My fear of causing issues for other Surface users might have made me a bit over-critical. At least for the Surface Laptop Go, I haven't run into any other issues.

Yeah no worries, most of our effort has been on the base images and we're now starting to get to other parts of the project. I find Surfaces challenging too (I can't even figure out which one to get!)
I think it's just a matter of test coverage, as people report different devices we can set it up to work ootb on as many as we can. And for the weird edge cases we can probably at least get them most of the way there. Keep filing as you see them and we'll keep iterating, thanks for your patience!


Fix a broken link on the webfont optimization page

Former link points to a 404, linking to project's main page instead.

I just signed it!


Missing "Disk and Cache Layers" dashboards when compared with 1.6

Is your feature request related to a problem? Please describe.
We are missing the Disk and Cache Layers dashboard like the harvest 1.6., especially the "Per Flash Pool Drilldown" Panel.
We want to monitor the "Flash Pool Capacity Used" - Read Cached/Write Cached and Total Capacity.
Describe the solution you'd like
A similar Panel in the Ontap:Disk or Ontap:Aggregate Dashboard for
Flash Pool Read Cached in GB
Flash Pool Write Cached in GB.
Flash Pool Total Capacity in GB.
Additional context
Today we a using 2 grafana instances (harvest 1.6 with nabox 2.6.4 and harvest 22.11.1-1 with nabox 3.2) to get all the information relevant for us.
When we get the Disk and Cache Layers dashboard like the harvest 1.6. we could switch off the harvest 1.6 Instance.

Verified in 23.02


wg_engine: fix incorrect geomatry

Fix computation of segments count for cubic curves.
Using screen coordinates of base points, instead of world coordinates.
Before/After

didn't check all the examples, but this solves AnimateMasking.cpp


Email to all non-newsletter non-opted out contacts

@rebeccalendl Are we planning to add them to the newsletter directly?

Yes, the same 'invite to opt out' email is going to be sent to:

Contacts in civi who are not already on email list, but have not actively opted out
CC staff contacts who are not already on the mailing list

I feel like we've discussed this so very many times, so want to make sure I'm not misunderstanding your question. Can you confirm?

Okay. I just want to make sure we get this right because undoing it will be a lot of work :)
Some staff contacts are explicitly not for the newsletter. How do we want to handle those? Just mark them as Do not email?

Anyone who has opted out should be marked as such, yes.
I agree we want to get this right and that it's a big project. I'd be happy to have a call tomorrow to run through any details.


Make lint script work for all the operating systems

Currently our lint script doesn't work on Windows, but works fine on Linux and MacOS.
Once the lint starts working for these operating systems, we could add linting in pre-commit hooks (not a part of this issue though). Refer issue #10

I will start analysis and do the needful

I will start analysis and do the needful

Sounds great! Assigning this issue to you.


Hacky Idea: ifelse in a pipeline

Problem Description
I am running benchmarks on many datasets. When the dataset contains a column called "date" then I am interested in running a different pipeline.
At the moment I fixed this by doing this:
class ConditionalDateFeaturizer(BaseEstimator, TransformerMixin):
    def __init__(self) -> None:
        self.spline_tfm = SplineTransformer(n_knots=12, extrapolation="periodic")

    def fit(self, X, y):
        if 'date' in X.columns:
            self.pipeline_ = make_union(
                make_pipeline(
                    SelectCols('date'),
                    FunctionTransformer(datetime_feats),
                    SplineTransformer(n_knots=12, extrapolation="periodic")
                ),
                TableVectorizer()
            )
        else:
            self.pipeline_ = TableVectorizer()
        return self.pipeline_.fit(X, y)

    def transform(self, X, y=None):
        return self.pipeline_.transform(X)

I wonder, could skrub maybe offer a nicer way to do stuff like this?
Feature Description
I don't know if we want this, but for large scale model search across multiple datasets you might want this. I also don't know if this is easy to generalise but I figured at least mentioning it in an issue here.
Alternative Solutions
The custom estimator also works, but it can get hacky quite quick once I want to repeat this pattern for other types of column features.
Additional Context
No response

With the upcoming "Recipe" (or "PipeBuilder" or whatever its name will be), it
will be easy to apply a transformation to only some columns.
For example you would be able to do something like this:
>>> import pandas as pd
>>> import numpy as np
>>> from sklearn.base import BaseEstimator

>>> from skrub._pipe_builder import PipeBuilder
>>> from skrub import selectors as s
>>> from skrub import TableVectorizer

>>> class DatetimeSplines(BaseEstimator):
...     "dummy placeholder"
...     def fit_transform(self, X, y=None):
...         return self.transform(X)
...
...     def transform(self, X):
...         print(f"\ntransform: {X.columns.tolist()}\n")
...         values = np.ones(X.shape[0])
...         return pd.DataFrame({"spline_0": values, "spline_1": values})

>>> pipe = (
...     PipeBuilder()
...     .apply(DatetimeSplines(), cols=s.all() & "date")
...     .apply(TableVectorizer())
... ).get_pipeline()

>>> df = pd.DataFrame({
...     "date": ["2020-01-02", "2021-04-03"],
...     "temp": [10.1, 17.5]
... })

The column "date" gets transformed by the spline transformer:
>>> pipe.fit_transform(df)

transform: ['date']

   temp  spline_0  spline_1
0  10.1       1.0       1.0
1  17.5       1.0       1.0

When there is no column matching the selector, the spline transformer is not applied:
>>> df = pd.DataFrame({
...     "not_date": ["2020-01-02", "2021-04-03"],
...     "temp": [10.1, 17.5]
... })

>>> pipe.fit_transform(df)
   not_date_year  not_date_month  not_date_day  not_date_total_seconds  temp
0         2020.0             1.0           2.0<PHONE_NUMBER>.0  10.1
1         2021.0             4.0           3.0<PHONE_NUMBER>.0  17.5

Does that more or less address the problem you are facing?

Having a conditional transformer might be useful when something more general than selecting columns is needed though, such as "apply a PCA if there are more than 200 columns"

However, if the important part is not really the name "date" but rather applying
the spline transformer to datetime columns only

Do we want to assume that the user ran their dataframe code or do we want our library to infer that on their behalf? I am partially asking because polars/pandas handle the date stuff slightly differently. But I am also wondering about categorical types. Do we only one-hot encode columns that are categorical?

for selecting all datetime columns you could use the skrub.selectors.any_date() selector -- I just need to update the PipeBuilder branch with the current state of PR #902 and I'll show a snippet

Do we want to assume that the user ran their dataframe code or do we want our library to infer that on their behalf? I am partially asking because polars/pandas handle the date stuff slightly differently. But I am also wondering about categorical types. Do we only one-hot encode columns that are categorical?

I think we will have the TableVectorizer which tries to guess on your behalf, and the PipeBuilder which allows to build your own  pipeline with more control over the different choices.
The TableVectorizer will one-hot encode anything that is strings or Categorical with a low cardinality. It will also try to parse strings as datetimes and apply the datetime_encoder if it succeeds

If you wanted to manually control your pipeline you could do something like:
import pandas as pd
import numpy as np

from skrub import ToDatetime
from skrub import selectors as s
from skrub._pipe_builder import PipeBuilder
from skrub._on_each_column import SingleColumnTransformer

class DatetimeSplines(SingleColumnTransformer):
    "dummy placeholder"
    def fit_transform(self, col, y=None):
        return self.transform(col)

    def transform(self, col):
        name = col.name
        print(f" ==> transform: {name}")
        values = np.ones(len(col))
        return pd.DataFrame({f"{name}_spline_0": values, f"{name}_spline_1": values})

pipe = (
    PipeBuilder()
    .apply(ToDatetime(), allow_reject=True)
    .apply(DatetimeSplines(), cols=s.any_date())
).get_pipeline()

>>> pipe = (
...     PipeBuilder()
...     .apply(ToDatetime(), allow_reject=True)
...     .apply(DatetimeSplines(), cols=s.any_date())
... ).get_pipeline()

>>> df = pd.DataFrame({
...     "A": ["2020-01-02", "2021-04-03"],
...     "B": [10.1, 17.5],
...     "C": ["2020-01-02T00:01:02", "2021-04-03T10:11:12"],
...     "D": ["red", "blue"],
... })
>>> df
            A     B                    C     D
0  2020-01-02  10.1  2020-01-02T00:01:02   red
1  2021-04-03  17.5  2021-04-03T10:11:12  blue

>>> pipe.fit_transform(df)
 ==> transform: A
 ==> transform: C
   A_spline_0  A_spline_1     B  C_spline_0  C_spline_1     D
0         1.0         1.0  10.1         1.0         1.0   red
1         1.0         1.0  17.5         1.0         1.0  blue

allow_reject means "let the ToDatetime transformer decide if it should be applied to the column or not (and reject those that don't look like dates). (by default it is false)

But if you want something completely automatic, eg that you are running on many datasets that you don't inspect manually, then you're probably better off using the TableVectorizer and let it do the preprocessing and those choices for you.
it will apply all those processing steps:

check input dataframe

fit_transform:

convert arrays to dataframes
ensure column names are strings
ensure column names are unique
check dataframe is not a pandas sparse dataframe
ensure dataframe is not lazy

transform:

same checks as fit_transform
check dataframe library is the same as in fit
check column names are the same as in fit

clean null strings

replace "N/A", "" etc with actual nulls

to datetime

try to parse strings as datetimes
ensure consistent output dtype (resolution + timezone awareness + timezone)

to float

try to convert anything but dates and categorical to float32
ensure consistent output dtype

clean categories (pandas)

ensure categories are strings stored with object dtype
ensure categorical columns don't contain pd.NA
ensure consistent output dtype

convert all remaining columns to string
convert pandas StringDtype to object & remove pd.NA
apply the user-defined transformers

low_cardinality_transformer (low-cardinality strings and categorical): by default one-hot encode, but you could use eg ToCategorical to take advantage of the HistGradientBoostingRegressor's categorical_features='from_dtype'  option
high_cardinality_transformer (high-cardinality strings and categorical): by default GapEncoder, MinHashEncoder can be a good choice
datetime_encoder (Dates & Datetimes -- including those that have been parsed from strings during preprocessing): by default DatetimeEncoder, you could replace it by the custom encoder with splines
numeric_encoder (numbers): by default, passthrough

try to convert all outputs to float32


S4D Memory Requirements

Hey, I wanted to give S4D a quick try in my research as a drop-in replacement of S4 (which, as far as I gathered, should be a good way to start), but I'm running into some hard memory limitations. I'm trying to train the DiffWave version of SaShiMi as a first experiment, but the memory requirements seem to increase significantly when replacing S4 with an equivalent S4D layer (with default settings), causing the model to go OOM in my case actually (so I don't have any precise measurements, but it's a 20% increase in overall memory consumption at least. I use the parameters as discussed in #46. Is this something you'd expect?

The implementation of S4D originally uploaded to this repo did not have a custom kernel for the Vandermonde multiplication. Materializing the matrix uses $O(HNL)$ space on this line whereas in principle it could be implemented with $O(H(N+L))$ space. These issues are talked about in Section 3.2-3.4 of the S4D paper.
S4D was originally meant to be pedagogical whereas S4 usually requires less tuning out of the box so I didn't implement the more efficient kernel S4D kernel at first. I now have a version using the pykeops library which will be released with v3. I can upload a version now; it could help us too if you did some tests to see if it works

Ah, that makes sense, thanks! I'd love to test it and see what kind of effect it has for me.

The new standalone file is here. This one includes all options for all models; for example, you would pass in mode=nplr for S4 or mode=diag for S4D, and then there are the usual arguments. This file is ported from our internal research repo and I'm still testing it, so please open issues if you find any snags.
The measures for S4D are a little different: they are diag-inv for S4D-Inv, diag-lin for S4D-Lin, and diag-legs for S4D-LegS. There's also a mixed option diag that combines S4D-Inv and S4D-Lin.
Note that we personally have found weird edge cases with S4D where it doesn't seem to do well on our YoutubeMix generation dataset out of the box. So far we found that only measure=diag-lin works, but that did slightly better than S4.
I'm still thinking about what else to release - while this file has the full model with every option, I was thinking about releasing an intermediate file similar to the current s4d.py standalone that's less scary than this one. The simplest one will be the s4d_minimal.py standalone which I'm planning to keep for pedagogical purposes (so a total of potentially 3 models with various levels of simplicity vs tunability). Curious if you have any opinions for what's most useful to you.
In the next two days I will be working on double checking and releasing the original Sashimi+Diffwave repo, so stay tuned!

Awesome, I'll give it a try. So just to make sure that I understood everything correctly: to do a drop-in-replacement of S4 -> S4D, I'd just take the S4 module and set mode='diag', measure='diag-lin' for a start, potentially switching the measure. Of course also adjusting the rest of the training process if needed.
Regarding your other question: Right now, I'm trying to apply a variant of SaShiMi trained in a diffusion context for my research. As I'm training on longer sequences than with Speech Commands, I run into memory limitations quickly (> 40GB of memory usage for a forward pass on one GPU with a batch size of 1/GPU), so I'm particularly interested in any additional efficiency I can get additionally to the more common efficiency optimizations.
Generally, the way in which the modules are provided is not that big of an issue for me (the current way is more than fine, although the standalone versions are definitely appreciated). The only immediate improvement I can think of off the top of my head is to make those parameters like mode and diag more directly available by including them as explicit arguments in the S4 class etc, as this can get somewhat confusing at times. Apart from that, there are of course some ways of improving immediate usability like via those standalone modules, which is definitely really good, but I don't think I personally have a large need for them. They're definitely appreciated though!

Trying it out in practice currently causes the pykeops implementation to raise an exception for me:
Traceback (most recent call last):
  File "[...]/env_a6000/lib/python3.8/site-packages/torch/multiprocessing/spawn.py", line 69, in _wrap
    fn(i, *args)
  File "[...]/learner.py", line 399, in train_distributed
    _train_impl(replica_id, model, dataset, args, params)
  File "[...]/learner.py", line 353, in _train_impl
    learner.train(max_steps=args.max_steps)
  File "[...]/learner.py", line 125, in train
    train_step_result = self.train_step(features)
  File "[...]/learner.py", line 172, in train_step
    predicted = self.model(noisy_audio, t, spectrogram)
  File "[...]/env_a6000/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1110, in _call_impl
    return forward_call(*input, **kwargs)
  File "[...]/env_a6000/lib/python3.8/site-packages/torch/nn/parallel/distributed.py", line 963, in forward
    output = self.module(*inputs[0], **kwargs[0])
  File "[...]/env_a6000/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1110, in _call_impl
    return forward_call(*input, **kwargs)
  File "[...]/model.py", line 495, in forward
    x, _ = self.sashimi((x, diffusion_step)) # input shape ((batch, length, channels), (batch, 1)); output shape (batch, length, channels)
  File "[...]/env_a6000/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1110, in _call_impl
    return forward_call(*input, **kwargs)
  File "[...]/src/sashimi/sashimi.py", line 946, in forward
    x, _ = layer(x, **layer_kwargs)
  File "[...]/env_a6000/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1110, in _call_impl
    return forward_call(*input, **kwargs)
  File "[...]/src/sashimi/sashimi.py", line 356, in forward
    y, _ = self.layer(y)
  File "[...]/env_a6000/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1110, in _call_impl
    return forward_call(*input, **kwargs)
  File "[...]/src/src/models/sequence/ss/standalone/s4.py", line 1371, in forward
    k, k_state = self.kernel(L=L, rate=rate, state=state) # (C H L) (B C H L)
  File "[...]/env_a6000/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1110, in _call_impl
    return forward_call(*input, **kwargs)
  File "[...]/src/src/models/sequence/ss/standalone/s4.py", line 1248, in forward
    return self.kernel(state=state, L=L, rate=rate)
  File "[...]/env_a6000/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1110, in _call_impl
    return forward_call(*input, **kwargs)
  File "[...]/src/src/models/sequence/ss/standalone/s4.py", line 1119, in forward
    K = log_vandermonde(C, dA.log(), L)
  File "[...]/src/src/models/sequence/ss/standalone/s4.py", line 101, in log_vandermonde
    r = vandermonde_mult(v, x, l, backend='GPU')
  File "[...]/env_a6000/lib/python3.8/site-packages/pykeops/torch/generic/generic_red.py", line 568, in __call__
    out = GenredAutograd.apply(
  File "[...]/env_a6000/lib/python3.8/site-packages/pykeops/torch/generic/generic_red.py", line 79, in forward
    result = myconv.genred_pytorch(
RuntimeError: [KeOps] Wrong number of args : is 3 but should be at least 4 in formula.

The same code was working with the previous S4D module, and I'm simply instanciating the S4 modules as S4(d_model, bidirectional=True, mode='diag', measure='diag-lin').

Hmm, I went to branch origin/v3 and added these lines to the bottom of the standalone file:
if __name__ == '__main__':
    torch.manual_seed(42)

    device = 'cuda' # 'cpu'
    device = torch.device(device)
    model = S4(256, bidirectional=True, mode='diag', measure='diag-lin')

then ran
python -m src.models.sequence.ss.standalone.s4
and this doesn't throw an error for me.
Can you try this? What version of torch and pykeops are you on?

Yes, I can confirm that this works for me, too. I'm on torch==1.11.0+cu113 and pykeops==1.5.

Ok, I'm not sure what the difference is between the instantiation that errors and the one that doesn't. They are being instantiated with the same call right?

Yes, the call is the same, except for the value for d_model.

Can you specify what value you're using then?

It's variable, different values from [64, 128, 256], as in the default small version of SaShiMi.

Also, you can try the latest version pykeops==2.1. I had issues with this version on certain CUDA versions, but it should work on later CUDA versions like 11.3
You can also try to follow their instructions to clear the cache here: https://www.kernel-operations.io/keops/python/installation.html#part-checkpython

It seems like I might actually have found the issue though. When I don't do distributed training (via DistributedDataParallel from PyTorch), this error does not seem to occur.

Okay, this is really weird - looking more deeply into this, it seems like I randomly get this kind of error (seems to change sometimes). I don't know what this is caused by, but it seems to be dependent on the system I train on, so it's most probably not caused by you. Please excuse the commotion - this seems like the error is likely not caused on your side of the code.
It's definitely a weird one, considering that I'm training on the same model GPU on different servers with the same software (maybe related to pykeops? That's the only thing I can think of).
I can confirm now though, that I got your pykeops implementation to work on one machine in both a single- and dual-gpu setup. I should be able to report some results on the performance impact from the new version tomorrow, provided that I get it to work at full scale.

Ok, feel free to file a separate issue as you narrow this down. This seems like quite a strange bug.
Also just to confirm, does this happen in the pykeops version of S4? If you pass in mode=nplr keops=True this should trigger the pykeops Cauchy kernel codepath.

Did you actually test training the current version of the S4 module in practice btw? Going back from S4D to S4 (and using default settings instead of mode='nplr', keops=True for the S4 module - those work) in my model breaks my training, as all gradients are NaN.
I condensed it down to this code to reliably trigger this issue on my end (adding it to the end of src.models.sequence.ss.standalone.s4:
if __name__ == '__main__':
    torch.manual_seed(42)

    device = 'cuda' # 'cpu'
    device = torch.device(device)
    # model = S4(256, bidirectional=True, mode='diag', measure='diag-lin').to(device) # works
    model = S4(256, bidirectional=True, mode='nplr').to(device) # torch.autograd.gradcheck.GradcheckError: Jacobian mismatch for output 0 with respect to input 0
    def f(x):
        return model(x)[0]
    print(model)
    torch.autograd.gradcheck(f, (torch.ones((1, 256, 2**6), requires_grad=True, device=device),))

going from S4D @ sequence length  with the normal implementation to the pykeops one (on pykeops==1.5) results in a 2.6 times memory reduction (40% of what it was before)
this is really great to know! that's even a bit better than I expected

Going back from S4D to S4 (and using default settings instead of mode='nplr', keops=True for the S4 module - those work) in my model breaks my training, as all gradients are NaN.
This works fine for me. I ran my standard testing command python -m train wandb=null pipeline=mnist model=s4 works fine. Adding +model.layer.keops=true still works as well. Let's start a separate issue for tracking this down

If the code works for you with keops=True but gives NaNs without, it's probably a problem with the CUDA extension for Cauchy. You can try uninstalling and reinstalling it (pip uninstall cauchy_mult, navigate to extensions/cauchy, and python setup.py install). Also keep in mind that it has to be recompiled for different environments (CUDA version, machine, GPU type, etc.) if those change, although usually it'll just throw an error instead of failing with NaNs if there's a mismatch. If it still doesn't work, filing a separate issue would be helpful so we can look into it, but you can just uninstall the extension and rely on pykeops.
One more thing: You can try upgrading to pykeops==2.1 if it works (I found an edge case, but when it works it's better than 1.5)

So, in general, reinstalling the Cauchy extension seems to have resolved most of the issues I was facing. Regarding my multi-GPU problems, PyKeOps seems to have some issues when multiprocessing is used and the filesystem where its cache is is not particularly fast, which I could hotfix by removing its ability to cache builds. I assume that this problem might also be responsible for some other issues I encountered, as it seems to both randomly crash some processes and cause unexpected behaviour in others. I haven't investigated it enough to open an issue there yet though.
Apart from that, I have recently encountered some NaN gradients again when using the S4 layer with nplr mode and default measure on the most recent v3 build when keops=True is specified that don't occur with any other S4 parameters I use. I haven't had the time to further look into this yet though, and I haven't checked whether I can reliably reproduce this either so far. If I can nail it down somewhat, I'll open another issue.

Ah yes I remember issues with pykeops 1.5 on multi-gpu and had to add some hacks with the cache folder. pykeops 2.1 is supposed to resolve some of these problems by avoiding the cache entirely; it has a much faster compilation time so it just doesn't cache the kernels.
So does your NaN gradient issue only occurs with keops=True or with the CUDA extension as well? I wonder if keops is causing any other hidden issues.

Good to know, thanks for the report! File an issue if you dig into it more


Add support for software QEMU virtualisation

In order to aid testing of Single VM mode on Travis this change adds a ciao-launcher option that lets you enable software QEMU. A follow-up PR will need to switch Single VM mode to use "auto" mode.

Coverage decreased (-0.06%) to 66.703% when pulling 8ad9cbe4ad21641b83f381effe890ce96ab9ed65 on rbradford:soft-qemu-testing into b938a427b384da39ae9d23da803f902451f42d47 on 01org:master.

@rbradford  I need to create a CNCI based on debian/centos as clear linux requires KVM to be able run. I am working on this right now. Will push an alternate CNCI image out shortly.

Coverage decreased (-0.08%) to 66.68% when pulling 9c835327becec37b1967f53d7b38d997f01be242 on rbradford:soft-qemu-testing into 9e17e735167c30a4fed946c4ee2d005e19a96c8f on 01org:master.

Works great. Thanks!


Missing OpenSSHUtils

This command does not work:
Install-Module -Force OpenSSHUtils -Scope AllUsers
Says no match for package was found.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 4c89b7b3-c05f-b517-6109-04e6a97195c3
Version Independent ID: 1e4b742e-d999-2c1e-a396-dc149f7ac76b
Content: OpenSSH key management for Windows
Content Source: WindowsServerDocs/administration/OpenSSH/OpenSSH_KeyManagement.md
Product: windows-server
Technology: administration
GitHub Login: @maertendMSFT
Microsoft Alias: damaerte

See also the following issues from https://github.com/MicrosoftDocs/windowsserverdocs/issues?utf8=✓&q="1e4b742e-d999-2c1e-a396-dc149f7ac76b"&in=body

#5552 Instructions to install deprecated OpenSshUtils module
opened 5 hours ago by zack-at-ds2

#5548 OpenSSHUtils Module not found
opened 14 hours ago by reuvygroovy

#5538 Outdated documentation
opened 3 days ago by aperally

#5408 Error: No match was found for the specified search criteria and module name 'OpenSSHUtils'
opened on Mar 26 by JoshSnider

#5395 Out of date - Repair-AuthorizedKeyPermission
opened on Mar 23 by nekdima

#5138 These instructions do not work on Windows 10 20h2
opened on Dec 19, 2020 by mihai-preda

#5000 Clarification needed
opened on Nov 10, 2020 by conyg

#4948 OpenSSHTools doesn't exist anymore on powershell gallery
opened on Oct 28, 2020 by JustinGrote

#4893 Install-Module OpenSSHUtils failure
opened on Oct 8, 2020 by LeeJenkins

#4787 OpenSSHUtils module does not exist
opened on Sep 4, 2020 by oliversalzburg

#4770 Error when following instructions to install OpenSSHUtils
opened on Aug 31, 2020 by c0f

#4743 Nope. First example errors out.
opened on Aug 22, 2020 by boomalator

#4702 OpenSSHUtils got unlisted from the PowerShell gallery
opened on Aug 5, 2020 by jagraveldinger

#4690 OpenSSHUtils install reference no longer valid
opened on Aug 1, 2020 by wrjohnson

#4634 More documentation required
opened on Jul 11, 2020 by garylawuk

#4622 Out-of-date - OpenSSHUtils no longer available.
opened on Jul 8, 2020 by Jammrock

#4598 Instructions provided ends with an error
opened on Jun 28, 2020 by jyavenard

#4345 OpenSSHUtils Not Needed
opened on May 14, 2020 by gynnantonix

#3806 OpenSSHUtils is deprecated
opened on Jan 28, 2020 by FizzBuzz791

Thanks for submitting this issue. I have reworked this document to remove or replace parts that are no longer relevant or correct based on this and several other issues raised for this page.
The changes should be visible in around 6-12 hours.
#please-close


Add AckslD/swenv.nvim

Checklist:

[x] The plugin is specifically built for Neovim.
[x] The lines end with a .. This is to conform to awesome-list linting and requirements.
[x] It's not already on the list.
[x] The title of the pull request is Add `username/repo`  when adding a new plugin.
[x] Neovim is spelled as Neovim (not nvim, NeoVim or neovim), Vim is spelled as Vim (capitalized), Lua is spelled as Lua (capitalized).
[x] If it's a colorscheme, it supports treesitter syntax.

Thanks for the PR!
Something went wrong with the syntax of your line, when you fix that I can merge your PR.

@tversteeg thanks for checking, what exactly went wrong? Looks fine to me but maybe I'm missing something.

neovim should be written as Neovim, and python as Python.


Add workflows for the ci repo itself

This PR instantiates the base workflow which includes the gitlint, license, yamllint and pylint checks o these checks are also ran on PRs in the bao-ci repo itself.
Also it adds a workflow that automates the build and publishing of the docker image to Docker Hub if an accepted PR contains modifications to the Dockerfile. The Docker Hub login secrets (user name and token) were already created for the repository.

@danielRep I've address your change requests.
@AfonsoSantos96 can you please add your review?

The pylint check is still failing. Need to solve it, before I accept. @josecm will send a PR to fix this, and after it it's merged to the main, this PR can be rebased and the pylint check won't fail.


If "bcc server" not accepting connections at the moment of pgbouncer start, bcc mode not working

I don't see re-connection attempts

Fixed.


Add support pagination parameters in groups.member

Add support pagination parameters in groups.member
https://developer.rocket.chat/reference/api/rest-api/endpoints/other-important-endpoints/offset-and-count-and-sort-info
in current implementation i can't get all group members ((

@scrattver hello. pagination added in https://github.com/badkaktus/gorocket/pull/7


Better testing

[ ] unit tests everywhere
[ ] replace broken feature tests with highest-level browser tests
[ ] test hours count in HR dashboard
[x] Test reports

Issue split into several smaller issues.


🌳 Discover "Ｔｈｅ Ｔｒｕｅ Ｎａｔｕｒｅ" NFTs

Hey @Kafierence thanks for your contribution, can you please fix the linter by usine npm run lint --fix or yarn lint --fix ? Thanks

Hey @Kafierence thanks for your contribution, can you please fix the linter by usine npm run lint --fix or yarn lint --fix ? Thanks

Thanks for reply , I already fix it


flutter skia --output-file foo.skp fails

@chinmaygarde @danrubel
Flutter crash report; please file at https://github.com/flutter/flutter/issues.

## command

flutter skia --output-file false.skp

## exception

Connection closed before full header was received

package:http/src/io_client.dart 78                                IOClient.send.
===== asynchronous gap ===========================
dart:async                                                        _Completer.completeError
package:http/src/io_client.dart 84                                IOClient.send.
===== asynchronous gap ===========================
dart:async                                                        _asyncErrorWrapperHelper
package:http/src/io_client.dart                                   IOClient.send
package:http/src/base_request.dart 116                            BaseRequest.send.
===== asynchronous gap ===========================
dart:async                                                        Future.Future.microtask
package:http/src/base_request.dart                                BaseRequest.send
package:flutter_tools/src/commands/skia.dart 47                   SkiaCommand.runInProject.
===== asynchronous gap ===========================
dart:async                                                        Future.Future.microtask
package:flutter_tools/src/commands/skia.dart                      SkiaCommand.runInProject
package:flutter_tools/src/runner/flutter_command.dart 192         FlutterCommand._run.
dart:async                                                        _SyncCompleter.complete
package:flutter_tools/src/cache.dart 184                          Cache.updateAll.
===== asynchronous gap ===========================
dart:async                                                        _asyncThenWrapperHelper
package:flutter_tools/src/runner/flutter_command.dart             FlutterCommand._run
package:flutter_tools/src/runner/flutter_command.dart 116         FlutterCommand.run
package:args/command_runner.dart 177                              CommandRunner.runCommand.
dart:async                                                        Future.Future.sync
package:args/command_runner.dart 130                              CommandRunner.runCommand
package:flutter_tools/src/runner/flutter_command_runner.dart 177  FlutterCommandRunner.runCommand.
dart:async                                                        _SyncCompleter.complete
package:flutter_tools/src/cache.dart 71                           Cache.lock.
===== asynchronous gap ===========================
dart:async                                                        _asyncThenWrapperHelper
package:flutter_tools/src/runner/flutter_command_runner.dart      FlutterCommandRunner.runCommand
package:args/command_runner.dart 104                              CommandRunner.run.
dart:async                                                        Future.Future.sync
package:args/command_runner.dart 104                              CommandRunner.run
package:flutter_tools/src/runner/flutter_command_runner.dart 123  FlutterCommandRunner.run
package:flutter_tools/executable.dart 94                          main...
===== asynchronous gap ===========================
package:stack_trace                                               Chain.capture
package:flutter_tools/executable.dart 88                          main.

## flutter doctor

[✓] Flutter (on Mac OS, channel master)
• Flutter at /src/flutter
• Framework revision bddeada5b6 (4 weeks ago), 2016-08-15 16:10:57
• Engine revision 9b320d8151
• Tools Dart version 1.20.0-dev.1.0
[✓] Android toolchain - develop for Android devices (Android SDK 23.0.2)
• Android SDK at /Users/eseidel/Library/Android/sdk
• Platform android-23, build-tools 23.0.2
• Java(TM) SE Runtime Environment (build 1.8.0_91-b14)
[✓] iOS toolchain - develop for iOS devices (Xcode 7.3.1)
• XCode at /Applications/Xcode.app/Contents/Developer
• Xcode 7.3.1, Build version 7D1014
[✓] Atom - a lightweight development environment for Flutter
• flutter plugin version 0.2.5
• dartlang plugin version 0.6.39
[✓] Connected devices
• Nexus 5 • 07e401a0d00b3699 • android-arm

I hooked up my Nexus 5X and tried the following:
examples/hello_world$ flutter run

then in a separate terminal
examples/hello_world$ flutter skia --output-file temp.skp

and it worked.
Based on the stacktrace above, it failed while making an http request
http.StreamedResponse skpResponse = await skpRequest.send();

Is there any way to get information about what happened in the engine when processing the request?

Maybe the port wasn't correctly forwarded to my host?  I'm happy to try again.

I was testing on a Nexus 5 at the time, I was attempting to produce and SKP for @chinmaygarde in https://github.com/flutter/flutter/issues/5867.


Chrome version?

I'd like to use this fork as you seem to have fixed the issues with the gelbooru API. It says in the readme.md that this is for firefox. any way to get it working on chrome too?

I'd like to use this fork as you seem to have fixed the issues with the gelbooru API. It says in the readme.md that this is for firefox. any way to get it working on chrome too?

Hello. Actually yes, it does work with chrome. Download the source zip file and in chrome, chose to install via zip file. There's a small bug however, clicking on booru slideshow will open 2 tabs for it. It's harmless, juste close one. You might need to enable dev mode on chrome to access the "install from zip" option.
You might also get a manifest warning at installation or first launch, it's just because the manifest file doesn't contain what chrome expects to find to identify the plugin, it's harmless too.
Note that this method also works on the Android browser Kiwi (and virtually any chromium based browser with the plugins options available) but it seems to randomly being uninstalled from it from time to time.

Thanks a lot! I installed it, but i get an error with gelbooru

No explicit, questionable or safe images were found.

You need to be logged in gelbooru for it to work.

oh ok. i didnt know because i didn't have to previously. thanks

doesn't seem to work


fix nuxt linting if @nx-plus/vue is installed

Current Behavior
Linting breaks inside a nuxt application if you install a vue lib. Steps to reproduce:

yarn create-playground
nx g @nx-plus/nuxt:app my-app
nx lint my-app -> 'All files pass linting'
nx g @nx-plus/vue:lib my-lib
nx lint my-app => 'Lint Errors...'

Expected Behavior
Nuxt and Vue should play nice together when using both in one repo. Nuxt uses v7 of eslint-plugin-vue (as a dependency of eslint-plugin-nuxt). I believe after installing a vue lib, nuxt will resolve v6 that our vue schematic adds.
Related Issue(s)

Fixes #

Tested this migration update and all others with verdaccio. Everything looks good.


Bug Report: cant build target windows on linux

$ lime build windows -32
/home/arceus413/haxelib/extension-webm/git/webm/WebmPlayer.hx:3: characters 8-15 : You cannot access the cpp package while targeting neko (for cpp.Lib)
source/WebmHandler.hx:12: characters 18-28 : ... referenced here
output if trying to build on windows
cant do 64 bit cuz rebuilding extension-webm only does it on 32 not 64

You targetted neko instead of cpp


1.1.0-Update

start a pull request for github action debug builds

waiting for github actions

Awesome, I'll take a look at it later today

bruh you merged it without me i was about to add another commit to this branch but oh well whats done is done

Sorry @awesomegamergame, I left the branch open though 😬

Yeah but I didnt wanted to remake another pull request so I just added all the code manually to master and pushed the update in the web data folder

Locking pull request now. Bye

Well the lock is useless then if collaborators can still talk


regarding evaluation commands

Hello,
I would like to ask a few questions regarding the evaluation of the Llama-Instruct model. Specifically:

Do you set use_chat_template and use multi-turn few-shot prompts during evaluation?
Is flash attention utilized if possible in your setup?

Additionally, I am working on reproducing the results of the VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct, which I believe is based on your work. Could you clarify if the work I mentioned here is fine-tuned using LoRA, or if it's utilizing a combination of Spectrum and QLoRA?
Thank you for your time and assistance.

Hi @sorobedio,

we have evaluated the model according to the specifications of huggingface. I.e. the lm eval harness version that hf uses for its leaderboard with chat template true.
without flash attn

You should find all further answers to your questions in the modelcard: https://huggingface.co/VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct
We used neither qlora nor lora for training but spectrum fft on 25% of the layers.
Regards,
David

thank you.


Update BaseX to 8.1.1

I remove #{version} to URL because version its also in file name but in different format.

Thank you for the contribution. It will be merged in the pull request referenced above due to some simple recommended alterations. Your contribution is still included (and still credited to you), with the appropriate modifications, when applicable.
Changes:

Facilitated future updates.
Squashed commits.

ok, thanks for your advice


reformatting cards

@v-kents,
Thanks for your contribution as a Microsoft full-time employee or intern. You do not need to sign a CLA.
Thanks,
Microsoft Pull Request Bot

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

globalization/breadcrumb/toc.yml
:white_check_mark:Succeeded

globalization/index.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


[SPARK-19115] [SQL] Supporting Create External Table Like Location

What changes were proposed in this pull request?
Support CREATE [EXTERNAL] TABLE LIKE LOCATION... syntax for Hive tables.
In this PR,we follow SparkSQL design rules :
supporting create table like view or physical table or temporary view with location.
creating a table with location,this table will be an external table other than managed table.

How was this patch tested?
Add new test cases and update existing test cases

I have created a new PR. Please review it, Thanks! @gatorsmile @cloud-fan

Can one of the admins verify this patch?

OK to test

OK to test

ok to test

I have run test cases successfully. Please run the test cases again.Thanks a lot! @SparkQA

retest this please

Test build #72745 has started for PR 16868 at commit 81feda4.

Test build #72745 has finished for PR 16868 at commit 81feda4.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72745/
Test PASSed.

Please update the PR description. This statement can be used for data source tables too.

You have good coverage for DDL statements. How about a test case for reading from external table creating using the command this PR enables ?

BTW: Hive can allow location of external table to be same as the source table. Can you please try that ? It should work. In the test case validations I see this check which will fail in such case:
assert(sourceTable.storage.locationUri != targetTable.storage.locationUri, ....

I think there is no need to do this validation, because the location is specified by users, So the targetTable.storage.lcaotionUri and sourceTable.storage.locationUri can be same or different. @tejasapatil

Please add a test case based on what @tejasapatil suggested. Thanks!

I think @tejasapatil's suggestion is reasonable, because the location is specified by users, So the sourceTable.storage.locationUri and targetTable.storage.locationUri can be same or different, Whether we need to be exactly the same as Hive?

In @tejasapatil's comment, Whether we need to be exactly the same as Hive? @gatorsmile

There are two main uses of EXTERNAL tables I am aware of:

Ingest data from non-hive locations into Hive tables. This can be covered by adding test case for reading from external table creating using the command this PR enables

Create a logical "pointer" to an existing hive table / partition (without creating multiple copies of the underlying data). Testing if the destination table can have the same location as of the source table will cover this.

I don't think Spark's interpretation of external tables is different from Hive's so its OK to support both.
BTW: If you are supporting 1st use case, one can mimic to get behavior of 2nd use case by creating external table with a fake location and later issuing a ALTER TABLE SET LOCATION command to make it point to an existing table's location. There is really no mechanism to guard against having EXTERNAL tables not point to an existing table / partition in Spark. So, both use cases were already possible in Spark

Do you mean that we don't need to do check whether the targetTable.storage.locationUri is the same with sourceTable.storage.locationUri or not ? @tejasapatil

we don't need to do check whether the targetTable.storage.locationUri is the same with sourceTable.storage.locationUri

We should not do that check for external tables. But continue doing that for other types of tables.

Very serious consideration. Thanks for your explanation and suggestion! what do you think? @gatorsmile @cloud-fan

Very thoughtful consideration. Thanks for your explanation and suggestion! @tejasapatil what do you think? @gatorsmile @cloud-fan

ok to test

Yes, the location can be the same or different from the original table.
LGTM pending test

Test build #72830 has started for PR 16868 at commit 71f4f1c.

Test build #72830 has finished for PR 16868 at commit 71f4f1c.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72830/
Test PASSed.

Thanks! Merging to master.


feat(twitch): show number of streams in past month

:tada: This PR is included in version 1.12.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Trim odometry data from optimization_problem

TrimTrajectoryNode 2d, 3d in optimization problem should also trim obsolte odometry data.

We added some projects to better communicate our short term roadmap. See https://github.com/googlecartographer/cartographer/projects/1. Our intention is to address trimming arbitrary parts of the odometry data.

Fixed by #655.


fix: avoid bulk unnecessary upstream resolver process and improve server logs

Skip the external upstream resolver (bulk) process when external resource manager is not found.
Add more server logs on job bounded context
Add replace all, refresh, and validation duration metrics

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

34 of 34 (100.0%)  changed or added relevant lines in 3 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+0.05%) to 91.662%

Totals

Change from base Build<PHONE_NUMBER>:
0.05%

Covered Lines:
8410

Relevant Lines:
9175

💛  - Coveralls


Magento/update nginx custom location

Move custom_server_location.conf inclusion in order to add possibility to add custom folders

Can't work with this because builded image add this required lines into custom_server_location.conf in order to Magento run code work
# Following code is included in the ~@~\location~@~] block of main server block
fastcgi_param HTTPS "on";
fastcgi_param MAGE_RUN_TYPE "website";
fastcgi_param MAGE_RUN_CODE $MAGE_RUN_CODE;

so new locations can't be added 😞