[Bug]: Targets seem very slow

Singer SDK Version
0.13.1
Python Version
3.10
Bug scope
Targets (data type handling, batching, SQL object generation, etc.)
Operating System
MacOS
Description
We have a target processing 1 million records and it takes a few hours, which seems pretty slow.
I tried creating a target that does nothing (so just measuring how slow the sdk itself is) and it takes around 3-4 seconds per 1000 records.
It spends about 60% of the time doing json schema validation, and another 35% doing _parse_timestamps_in_record.
Firstly, I'm wondering what the point in '_parse_timestamps_in_record' is generally; I can see how it would be useful for some targets but not enough to justify doing it for all targets, since many won't need that (and will then have to parse them back!)
I couldn't see anything obviously wrong with the validation, though I'm on the fence about how necessary it is; I wonder if you can just assume that the tap it outputting valid data 🤔
I heard of a library, but haven't used it myself, called fastjsonschema which is supposed to be faster, so that could be one idea.
Code
No response

Hey @Jack-Burnett!
Thanks for reporting!

It spends about 60% of the time doing json schema validation

This is not great. The purpose of this AFAICT is to fail early when records are not valid and would cause errors later when trying to persist them to the target.
I wonder if deserializing and schema validation would be improved by low-level bindings to Rust code with explicit structs for Singer messages, so they're quicker to parse and validate.

and another 35% doing _parse_timestamps_in_record.
Firstly, I'm wondering what the point in '_parse_timestamps_in_record' is generally; I can see how it would be useful for some targets but not enough to justify doing it for all targets, since many won't need that (and will then have to parse them back!)

I agree, perhaps we can make that a toggle at the target class level, so developers can choose whether to keep this behavior in their targets. Wdyt?

@Jack-Burnett  awesome! I can confirm the speed has smelled for a while I have some good production test scenarios for target-mssql if / when we get good traction on this :D

One note from thinking about validation in https://github.com/MeltanoLabs/tap-csv/pull/88#pullrequestreview-1187097991:
We probably don't want to change how validation works for the target configuration, just for records.

Related:

https://github.com/meltano/sdk/issues/260
https://github.com/meltano/sdk/issues/1836

We should probably refactor this method to make it pluggable so target developers are able to make it a no-op if that makes sense for their destination.

We should probably refactor this method to make it pluggable so target developers are able to make it a no-op if that makes sense for their destination.

This was done in a slightly manner by https://github.com/meltano/sdk/commit/631d5df03bd3afef40763ac01b9f169169ec4135, shipped with https://github.com/meltano/sdk/releases/tag/v0.35.0.
Comment if this is still a problem.


Add syntax highlighting; Fix typo [ci skip]

I noticed that shell code blocks are not syntax highlighted and also the initial ruby block wasn't highlighted.
I also removed the line mentioning https://github.com/konvenit/cypress-on-rails as that repo now redirects to this repo.

So it's not really giving proper credit to @konvenit.
I'd suggest to instead write that this work is based off of work from the @konvenit team.

Thanks @grantspeelman and @vfonic!


The information on waypoints

Hi, all,
Now I'm somewhere inbetween the path generation and the path planning. I've got a path generated by /waypoint_clicker. The used vector maps for this are included in sample_moriyama_data. The path generated by Publish Point (actually, Op Flag) on RViz is going along a dim yellow line

This path is then saved as

...
Here, only 24 rows are displayed, but actually it includes 474 rows, which means 474 waypoints.
1) How can the number of waypoints be decided?
And I think

1st~3rd columns refer to the coordinate (x, y, z, respectively) of waypoints
4th column represents the direction
5th column denotes the (target) velocity.

I've plotted those

At the intersection, the value of the direction abruptly changes from about +2 to -2~-3.
2) What can be the unit (orientation) of the direction?
Thanks for your interest!

Hi,
Question1: Please check these codes, waypoint_clicker.cpp, lane_planner_vmap.hpp
The number of points are determined by your clicks and vectormap info.
Question2: Unit for orientation(yaw) is radian.

@cirpue49, thanks for your reply :)
If possible, would you please a bit more elucidate your answer 2)?
Yes, the unit is radian (0~2*pi) but why does it change from plus to minus while passing by the intersection in the middle?
I've just searched for the possible orientations of vehicle heading (yaw) but there are many
http://street.umn.edu/VehControl/javahelp/HTML/Definition_of_Vehicle_Heading_and_Steeing_Angle.htm
https://stackoverflow.com/questions/17574424/how-to-use-atan2-in-combination-with-other-radian-angle-systems
http://docs.polysync.io/articles/tutorials-and-examples/tutorials/vehicle-sensor-alignment/
...
Would you tell me the orientation of vehicle heading (yaw) defined in Autoware?
Thank you, @cirpue49!

Please check the code.
lane_planner_vmap.cpp#405
It uses atan2.

@cirpue49, all right, thank you! :)


[bug] <ThemeInverse /> breaks with next build

I'll make a full repro soon...but the following issues exist with ThemeInverse:
1. Broken in web prod
If I yarn next build, then ThemeInverse doesn't seem to apply at all. Kinda odd. I inspected the output HTML, and it's outputting class="light" in the place where I put ThemeInverse. I believe it should be class="t_light", right? When I change it to t_light it gets fixed.
2. Doesn't SSR (separate issue, I believe)
In dev mode, the themeInverse does work, but it has a pretty significant flicker since it's not SSR'ing. Not as big of a deal as the issue above, but maybe it could be made a bit faster by using a layout effect or something. Separate issue, just thought I'd flag it first.

Here's a screenshot of the output. I'll investigate the component to see what's up.

While in dev mode, the correct theme is added.

I suspect there may be some issue related to useThemeName, since using this inside of modals to fix nested themes doesn't work on Web.

This is what I see for <View themeInverse debug="verbose" /> in dev. It doesn't log anything for yarn next build.
useTheme => dark_gray_alt1
     themeName undefined
     componentName undefined
     name dark_gray_alt1
     className undefined
 🐛 [Unnamed Component]  tamagui
  initial props/state
    props {
      debug: 'verbose',
      children: {
        '$$typeof': Symbol(react.element),
        type: {
          '$$typeof': Symbol(react.forward_ref),
          render: [Function: WithTheme],
          Text: [Function: Text]
        },
        key: null,
        ref: null,
        props: {
          accessibilityLabel: 'Buy Tickets',
          size: '$3',
          children: [Object]
        },
        _owner: null,
        _store: {}
      }
    }
    splitStyles {
      fontFamily: undefined,
      viewProps: {
        children: {
          '$$typeof': Symbol(react.element),
          type: [Object],
          key: null,
          ref: null,
          props: [Object],
          _owner: null,
          _store: {}
        }
      },
      style: {},
      medias: {},
      mediaKeys: [],
      pseudos: {},
      classNames: {
        flexDirection: '_fd-column',
        minWidth: '_miw-0px',
        minHeight: '_mih-0px',
        position: '_pos-relative',
        boxSizing: '_bxs-border-box',
        flexBasis: '_fb-auto',
        display: '_dsp-flex',
        flexShrink: '_fs-0',
        alignItems: '_ai-stretch'
      },
      rulesToInsert: []
    }
    className [
      '_fd-column',
      '_miw-0px',
      '_mih-0px',
      '_pos-relative',
      '_bxs-border-box',
      '_fb-auto',
      '_dsp-flex',
      '_fs-0',
      '_ai-stretch'
    ]
  render <div /> with props {
    ref: [Function (anonymous)],
    className: '   _fd-column _miw-0px _mih-0px _pos-relative _bxs-border-box _fb-auto _dsp-flex _fs-0 _ai-stretch',
    style: {}
  }
    ref [Function (anonymous)]
    className    _fd-column _miw-0px _mih-0px _pos-relative _bxs-border-box _fb-auto _dsp-flex _fs-0 _ai-stretch
    style {}
    children {
      '$$typeof': Symbol(react.element),
      type: 'div',
      key: null,
      ref: [Function (anonymous)],
      props: {
        className: '   _fd-column _miw-0px _mih-0px _pos-relative _bxs-border-box _fb-auto _dsp-flex _fs-0 _ai-stretch',
        style: {},
        children: {
          '$$typeof': Symbol(react.element),
          type: [Object],
          key: null,
          ref: null,
          props: [Object],
          _owner: null,
          _store: {}
        }
      },
      _owner: null,
      _store: {}
    }

I see it working properly on next.js:

Production works the same as well.
The issue with flicker is legit, though should be able to be overcome eventually. It uses layout effect already. But likely we can just use context and get the right parent theme name always. Just need to try it out.

yeah i think it works for me on a newer version actually

flicker might make sense due to the layout effect, i’m just not sure why it takes so long. maybe naive question, but on web could the flicker be avoided with CSS classes somehow?
what if there were a dark_Inverted class for instance, and rather than flipping the theme, it just used t_dark_Inverted on web or something?

I think these issues are at least improved on the new releases.


added treasurers

Also, it looks like you grabbed data for all of the previous elections. Can you please update the files so that is is just November 2018 election? For this initial version, we want to focus on the General Election November 6, 2018. I believe each election has a certain timeframe for which contributions are allowed. For the November 6, 2018, I think contributions are considered from 2017-2018.

Hi @ychoy! My bad. I just updated the files for the correct cycle.


Removing large zarr stores recursively blows up memory

I am trying to remove a rather large zarr store from the pangeo scratch bucket:
I am doing this on the pangeo google deployment (production)
import fsspec
import os

fs = fsspec.filesystem('gcs')
print(fs.ls('pangeo-scratch/jbusecke/detrending_test/'))

for path in fs.ls('pangeo-scratch/jbusecke/detrending_test/'):
    fs.rm(path, recursive=True)
    print(f'Finished with {path}')

This will take some time, over which memory usage on the notebook process increases steadily and eventually the kernel crashes.
Is this a misuse of fsspec (I am very new to all of this).
Or is this a bug that might have a workaround? Any help to debug this would be greatly appreciated.

This seems like a very reasonable thing to do. Please post your versions. Do the files in the paths that execute before crash successfully disappear?

Hi @martindurant, sorry for the radio silence. I was on vacation and stuff got a bit hectic before leaving.
So this occurs with version '2021.04.0' of fsspec, what other package versions would be helpful for you to know?
Here is the output of xr.show_versions() just in case:
INSTALLED VERSIONS
------------------
commit: None
python: 3.8.8 | packaged by conda-forge | (default, Feb 20 2021, 16:22:27)
[GCC 9.3.0]
python-bits: 64
OS: Linux
OS-release: 5.4.109+
machine: x86_64
processor: x86_64
byteorder: little
LC_ALL: C.UTF-8
LANG: C.UTF-8
LOCALE: en_US.UTF-8
libhdf5: 1.10.6
libnetcdf: 4.7.4

xarray: 0.17.0
pandas: 1.2.4
numpy: 1.20.2
scipy: 1.6.2
netCDF4: 1.5.6
pydap: installed
h5netcdf: 0.11.0
h5py: 3.2.1
Nio: None
zarr: 2.7.1
cftime: 1.4.1
nc_time_axis: 1.2.0
PseudoNetCDF: None
rasterio: 1.2.2
cfgrib: <IP_ADDRESS>
iris: None
bottleneck: 1.3.2
dask: 2021.04.1
distributed: 2021.04.1
matplotlib: 3.4.1
cartopy: 0.19.0
seaborn: None
numbagg: None
pint: 0.17
setuptools: 49.6.0.post20210108
pip: 20.3.4
conda: None
pytest: None
IPython: 7.22.0
sphinx: None

Do the files in the paths that execute before crash successfully disappear?

I think some of the chunks were successfully deleted if I remember correctly. I just tried it again with a larger RAM server and I was able to delete the smaller of two zarr stores similiarly large stores successfully, but the memory usage was quite high still (went up about 2+GB, and for the larger one it blew the memory out again).
Is the memory footpring supposed to scale with the size of the deleted folder?
Do you have any suggestions for further debugging? Many thanks.

@isidentical , do you think it might help to replace the explicit asyncio.gather in GCSFileSystem._rm with the throttled version?
@jbusecke , it is hard to tell where the memory runs out - it would be useful to know whether it is during the listing of the files or when issuing the delete calls. If some files were indeed deleted, this suggests the latter, in which case my suggestion in the line above might help. Also, you might try increasing the batchsize argument to rm, which makes for fewer, larger calls (and I think it's the number of calls which will pose the problem).
Another improvement we could make, if to add an on_error argument, as is done for some other batch methods, so that we can avoid return_exceptions=True in gather, which might present a memory saving for failed calls.

@isidentical , do you think it might help to replace the explicit asyncio.gather in GCSFileSystem._rm with the throttled version?

If the memory consuption is scaled with the number of calls to _rm_files, then yes it might work.

@jbusecke , the throttled gather is fsspec.asyn._run_coros_in_chunks, where you would specify a chunksize. Would you like to try to implement this, see if it helps?
@isidentical , it occurs to me that it might be nice if that function accepted a generator for coros, not just a list, so that they don't all need to be instantiated ahead of time.


Azure Search: No content fields found. Please confirm if you have String fields which are searchable!

Library name and version
Azure.AI.OpenAI 1.0.0-beta.12
Describe the bug
When trying to search an index that only has searchable field of type StringCollection I get a bad request response. as you can see here

Expected behavior
In Azure AI Search, both field types String and StringCollection are searchable. So I should be able to search the index using any searchable field regardless of it's type.
Actual behavior
When running the code I get HTTP code 400 response from the API.
{"error": {"requestid": "6003d42d-13b4-454f-90d9-287b3af6213b", "code": 400, "message": "Invalid AzureCognitiveSearch configuration detected: Call to get ACS index failed. Check you are using correct index, instance and api_key.\nAzure Search: No content fields found. Please confirm if you have String fields which are searchable!"}}

Reproduction Steps
Create an Azure Search AI index with no String fields. Add at least one StringCollection field.
Then try to use Azure.AI.OpenAI model to search that index. This throw the exception listed above
Here is the code I use to search my Azure Search AI index
try
{
    var completion = await _openAIClient.GetChatCompletionsAsync(new ChatCompletionsOptions("my-chat-deployment-name", [new ChatRequestUserMessage("Something to search for")])
    {
        AzureExtensionsOptions = new AzureChatExtensionsOptions()
        {
            Extensions =
            {
                new AzureCognitiveSearchChatExtensionConfiguration()
                {
                    SearchEndpoint = new Uri("https://my-endpoint"),
                    Key = "My key",
                    IndexName = "the-azure-search-ai-index-name",
                },
            }
        }
    });

    // ...
}
catch (Exception ex)
{
    _logger.LogError(ex, "Unable to complete chat using Azure AI Completion model.");
}

The above code works when searching an index that has String field.
Environment
No response

@bleroy can you please confirm that StringCollection should be searchable just like String type would in Azure Search AI? I am just trying to determine if this is a limitation in the Azure Search AI or an issue or limitation in chat completion on your own data?

@MikeAlhayek not sure why you're tagging me. I think so, but that's not my area of expertise.

Sorry! I thought you had an answer to the Azure Search AI portion.

I work on the indexer. You'll want to ask someone on the search engine side of the team. As far as I can tell from the documentation, collections of strings are supported: https://learn.microsoft.com/en-us/rest/api/searchservice/supported-data-types

Thank you for your feedback.  Tagging and routing to the team member best able to assist.

@MikeAlhayek - Azure AI Search supports both string and collection of strings, both of which are searchable. Check out an example here, where HotelName is a string field and Tags is a collection of strings, both marked as searchable.
Refer to the docs here for more details:

"searchable": true (default where applicable) | false (only Edm.String and Collection(Edm.String) fields can be searchable).

Are you possibly missing FieldMappingOptions in the provided code snippet? Consider the following:
AzureExtensionsOptions = new AzureChatExtensionsOptions()
{
    Extensions =
    {
        new AzureCognitiveSearchChatExtensionConfiguration()
        {
            SearchEndpoint = new Uri("https://my-endpoint"),
            Key = "My key",
            IndexName = "the-azure-search-ai-index-name",
            FieldMappingOptions = new AzureCognitiveSearchIndexFieldMappingOptions()
            {
                ContentFieldNames = { "MyContentField" }
            }
        },
    }
}

For more details on using extensions in OpenAI, @trrwilson or @joseharriaga can provide additional assistance.

@ShivangiReja FieldMappingOptions is optional and not required. I am not sure if providing them will enhance the result. Any how, I tried adding them and ended up with the same result.
Please note that my code works  on a different index. For example, if you look at this other index, searching works as expected. The key difference between the two indexes is that this one has at least one searchable String type field whereas the other one has searchable SearchCollection fields.

@MikeAlhayek Even if you have no searchable string field and only have searchable SearchCollection fields, it should still be a valid index, and the functionality should work as intended. I've added a sample based on your scenario using the search library. You can review the example here, showcasing only a searchable SearchCollection field and no searchable string field (lines 74-75). The sample works correctly and returns the expected results.
Could you please try utilizing only the search library to determine if it provides the expected response? If an error persists, it might be related to the Azure AI Search. If there's no issue, then it could indicate a problem with Azure Open AI.

@ShivangiReja your code does not use the Chat Completion code. It utilizes the Search AI index by creating an index, pushing content and then performing a search. This all works for me as expected as well. This is all working as part of OrchardCore CMS
The part that isn't working as expected in the GetChatCompletionsAsync using AzureCognitiveSearchChatExtensionConfiguration. Again the same code work fine when my index contains searchable String field. But it does not seems to search when there are no searchable String field.

@joseharriaga could you please help @MikeAlhayek with utilizing the extensions in OpenAI?

@ShivangiReja @joseharriaga There has been no activity on this issue. I am wondering if there is a plan to fix this issue soon? In a short summary, it appears that the Azure OpenAI (C# SDK) on your own data does not search within a string-collection field types. I can't imagine this being a limitation, so I am assuming it is a bug in the SDK.


the latest version of cocoapods is still 3.9.1 that can not use in swift 4.0

Check List
Thanks for considering to open an issue. Before you submit your issue, please confirm these boxes are checked.

[ ] I have read the wiki page and cheat sheet, but there is no information I need.
[ ] I have searched in existing issues, but did not find a same one.
[ ] I want to reoprt a problem instead of asking a question. It'd better to use kingfisher tag in Stack Overflow to ask a question.

Issue Description
What
[Tell us about the issue]
Reproduce
[The steps to reproduce this issue. What is the url you were trying to load, where did you put your code, etc.]
Other Comment
[Add anything else here]

Maybe it is worth trying pod repo update first.


Link Movement Method

Wow, this is a fantastic library! Thanks for making it and sharing :)
Is there way to create clickable links with FastTextView? Because the library renders it's own text and does not extend TextView, I am unable to use any movement methods.
Specifically, I need a TextView that allows me to set a custom ellipsis such as "...Continue Reading" and support links. Sounds easy but it's a tall order!

Closing due to inactivity.

I've tried to use Linkify to add link but it's show blank on link text area.


Developer productivity related feedback. Multiple issues; needs triage from core team member.

Hello,
I’m trying out Hugo and ended up chronicling some of the many stumbles that I think could have been avoided. Not all of these are easily addressable, but I’d like to bring them up anyway, in case there is interest in fixing some of them.
Instead of filing separate bugs, I figured it would be best to file a single issue capturing all the details, and for a project maintainer with more historical context to step in and triage appropriately, and perhaps filing specific bugs as needed.
Here are the things I noted.

Naming inconsistencies:

CLI requires --canonifyURLs; config.toml equivalent is canonifyurls (different case)
CLI requires --destination; config.toml equivalent is publishDir.
baseURL versus canonifyurls: should acronyms be CamelCase, or UPPERCASE?
DefaultContentLanguage versus languageCode: should the first letter be lower-case or upper-case?

Capitalization in many places seems arbitrary. A parameter named baseUrl is accessed as .Site.BaseUrl (note, upper case B), while a custom parameter named fooBar is accessed as .Params.foobar (note, all lower case).

Templates, layouts, themes, sections, types, etc. are all closely-related yet distinct terms, making them confusing. Even for someone well-experienced in other static page generators, the official docs add to the confusion instead of trying to explain what the specific terms mean. It would be nice to have a single page describing these high-level concepts in relation to one another. Users currently have to follow trails through multiple links to figure out what these basic terms mean.

Layouts are specified in a layouts/ directory but invoked using a type = layout_name parameter.

Homepage is special, and must be named _index.md. Simply doing the straightforward thing (as you would in any other directory) and putting a index.md (no leading underscore) ends up rendering a blank page using the (again, special!) home page template, but with no content (because, of course, Hugo was only looking for a _index.md and completely ignored the index.md that was, in fact, present.) There are no warnings about this; users are expected to figure this out on their own.

Error messages are confusing. Specific example: Even when the tool fails to generate many many files, the final summary numbers are still for the full set of files it processed, not subtracting any that were skipped because of errors.

Things that should be errors are instead WARNings and hidden in the default output unless --verbose is turned on. Basic errors such as pointing to non-existent templates and layout files should be flagged even without --verbose.

{{- .Title -}} should have been the default instead of {{ .Title }}.

When running as hugo server --watch, deleting the publishDir should also trigger a re-publish.

Thanks for listening!

It's also kind of worrisome that the project has ~250 open issues on GitHub.

@manastungare, no, you should enter individual bugs.
@peterlindstrom123, this is a version 0.29 product. It is free and open source. Please be more fair and grateful. Even better, go fix some of those bugs.

@vassudanagunta I went ahead and posted to the forum. Seeing as how this post hasn’t received any comments, other than yours, I’ll wait to see if there’s a response at that venue.
I’ll close this bug. If there is interest from the core team, they can re-open it.


Postgres example uses Mongodb

** READ THIS FIRST! **
Are you looking for help?
Reminder: The issue tracker is not a support forum.
Issues should only be filed in this project once they are able to be reproduced
and confirmed as a flaw in the software or incorrect information in associated
documention.
If you are encountering problems integrating this module into your application,
please post a question on the discussion forum
rather than filing an issue.
Is this a security issue?
Do not open issues that might have security implications.  Potential security
vulnerabilities should be reported privately to<EMAIL_ADDRESS> Once any
vulerabilities have been repaired, the details will be disclosed publicly in a
responsible manner.  This also allows time for coordinating with affected parties
in order to mitigate negative consequences.
If neither of the above two scenarios apply to your situation, you should open
an issue.  Delete this paragraph and the text above, and fill in the information
requested below.

The provided example in the Documentation is actually using mongodb instead of Postgres on node.js, why is that?
Expected behavior

I would expect the Postgres example to use Postgres database.
Actual behavior

Mongodb is being used in the example.
Steps to reproduce

Read the documentation. The Postgres example actually uses mongodb
// Format code using Markdown code blocks

Environment

Operating System:
Node version:
passport version:

I'm not sure what example this is referring to.


Wrong Prompt on Library Starling-lm Modelfile

Hi,
prompt in library model starling-lm is wrong.
Later has been fixed (in this thread) that it must be:
GPT4 User: {prompt}<|end_of_turn|>GPT4 Assistant:
I've tested locally with the following Modelfile:
FROM starling.gguf
TEMPLATE """{{ .System }} GPT4 User: {{ .Prompt }}<|end_of_turn|>GPT4 Assistant:"""
PARAMETER num_ctx 4096
PARAMETER stop "<|endoftext|>"
PARAMETER stop "<|end_of_turn|>"

Naturally, num_ctx can be omitted.

Thanks! This is fixed now


JAMES-3693 Fixup parsing redisURL when cluster with multi url endpoint

BUG

Before: Ex: redisURL=redis://redis1:6379,redis://redis2:6379 Then RedisUris has size = 1

Reason
When runtime, the Configuration is org.apache.james.utils.DelegatedPropertiesConfiguration with delimiter is ,
=> config.getString("redisURL") return only the first element of an array
Expected
RedisUris has size = 2 with example above

Before: Ex: redisURL=redis://redis1:6379,redis://redis2:6379 Then RedisUris has size = 1

What was the value?

Before: Ex: redisURL=redis://redis1:6379,redis://redis2:6379 Then RedisUris has size = 1

What was the value?

redis://redis1:6379


GitHub Enterprise not supported

I get following message when verifying my GitHub Enterprise token that has Copilot permissions.
Status code 401, "{"error":{"code":"unauthorized","message":"Your account type is not currently supported","details":"Your account type is not currently supported"}}"

The exact same granular token scope for my other account yields
Configuration is valid.

Thanks a lot

Hey @hemeroc,
this is a response from GitHub API. I'm not sure if this is a problem with the plugin?

Hey @hemeroc,
this is a response from GitHub API. I'm not sure if this is a problem with the plugin?

Most likely GitHub Cloud and GitHub Enterprise Cloud need to be treated differently.
Could be that this is an upstream issue with langchain4j.
Would you report it to langchain4j?

@hemeroc  Do you have checked the option to enable GitHub Models in Enterprise Settings/Policy ?
Go to Enterprise Settings > Policies > Models and check the option "Models Access".
Here it's working 100% with GitHub Enterprise + GitHub Models.


possible unexpected behavior

First of all, thanks for the addition of StyledStrings to the standard library, looks fantastic!
While trying it out, I found a possible unexpected behavior.
As I would expect, the styled string str1 = styled"{yellow:is this {blue:blue or yellow}}" prints yellow for "is this " and blue for "blue or yellow". However,  str2 = styled"{yellow:{blue:blue or yellow}}" prints yellow while I would expect it to print blue.
Is this expected?
Extra info in case it helps:
julia> sprint(print, str1, context = :color => true)
"\e[33mis this \e[34mblue or yellow\e[39m"

julia> sprint(print, str2, context = :color => true)
"\e[33mblue or yellow\e[39m"

and
julia> Base.annotations(str1)
2-element Vector{Tuple{UnitRange{Int64}, Pair{Symbol, Any}}}:
 (1:22, :face => :yellow)
 (9:22, :face => :blue)

julia> Base.annotations(str2)
2-element Vector{Tuple{UnitRange{Int64}, Pair{Symbol, Any}}}:
 (1:14, :face => :blue)
 (1:14, :face => :yellow)

it looks like the order of the annotations in the second case wasn't set properly?

versioninfo:
julia> versioninfo()
Julia Version 1.11.0-alpha2
Commit 9dfd28ab751 (2024-03-18 20:35 UTC)
Build Info:
  Official https://julialang.org/ release
Platform Info:
  OS: Linux (x86_64-linux-gnu)
  CPU: 8 × 11th Gen Intel(R) Core(TM) i7-1165G7 @ 2.80GHz
  WORD_SIZE: 64
  LLVM: libLLVM-16.0.6 (ORCJIT, tigerlake)
Threads: 1 default, 0 interactive, 1 GC (on 8 virtual cores)
Environment:
  JULIA_PROJECT = @.

I installed Julia using juliaup.

Thanks for the issue! I agree that this is pretty unintuitive behaviour, and if you are able to check out #44 you should find it behaves as you expect there 🙂


Add Collection API

This PR adds support fpr the Collection API (implements https://github.com/huggingface/huggingface_hub/issues/1682).
EDIT: PR is ready for review. Tests are still failing but a server-side change is coming (https://github.com/huggingface/moon-landing/pull/7548)
Documentation:

Guide
Package reference
HF-hub docs: incoming

Create/get/update/delete collection:

get_collection
create_collection: title, description, namespace, private
update_collection_metadata: title, description, position, private, theme
delete_collection

It does not include a way to list/search collections. We can do that in a later PR once it's fully supported server-side (currently only possible to list your own collections).
Add/update/remove item from collection:

add_collection_item: item id, item type, note
update_collection_item: note, position
delete_collection_item

Usage
>>> from huggingface_hub import get_collection
>>> collection = get_collection("TheBloke/recent-models-64f9a55bb3115b4f513ec026")
>>> collection.title
'Recent models'
>>> len(collection.items)
37
>>> collection.items[0]
CollectionItem: {
    {'_id': '6507f6d5423b46492ee1413e',
    'id': 'TheBloke/TigerBot-70B-Chat-GPTQ',
    'author': 'TheBloke',
    'item_type': 'model',
    'lastModified': '2023-09-19T12:55:21.000Z',
    (...)
}}

>>> from huggingface_hub import create_collection

# Create collection
>>> collection = create_collection(
...     title="ICCV 2023",
...     description="Portfolio of models, papers and demos I presented at ICCV 2023",
... )

# Add collection with a note
>>> add_collection_item(
...     collection_slug="davanstrien/climate-64f99dc2a5067f6b65531bab",
...     item_id="datasets/climate_fever",
...     item_type="dataset"
...     note="This dataset adopts the FEVER methodology that consists of 1,535 real-world claims regarding climate-change collected on the internet."
... )

TODO

[x] merge moon-landing/7536 (internal)
[x] merge moon-landing/7538 (internal)
[x] merge moon-landing/7548 (internal)
[x] add unit test
[x] add Collection API to package reference (methods + classes)
[x] add guide about Collection API
[ ] document public API in hf-docs (different PR)

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

cc @vwxyzjn who was wondering whether this was possible or not

Thank you so much for the guide review @stevhliu ! :heart: I've addressed all of your comments which is always a great improvement to the guide :tada:

Server-side PRs are not all merged and tests are green :heavy_check_mark:.
Still having a code quality error but it's been solved in https://github.com/huggingface/huggingface_hub/pull/1693 (types-requests got updated) and in PR documentation which is being solved in https://github.com/huggingface/doc-builder/pull/405. Both are not related to this PR.
So thanks @LysandreJik and @stevhliu for the reviews, I think we're good to merge now! :tada: :rocket:

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

Would adding a collection_url/url attribute to the Collection object make sense? I realise this can easily be got from the slug i.e. f"https:huggingface.co/collections/{collection.slug}" but maybe it's nice to make it easier for a user to quickly access that so they can check their collection via the Hub more quickly?

Would adding a collection_url/url attribute to the Collection object make sense? I realise this can easily be got from the slug i.e. f"https:huggingface.co/collections/{collection.slug}" but maybe it's nice to make it easier for a user to quickly access that so they can check their collection via the Hub more quickly?

Yes that makes a lot of sense for usability, thanks for the suggestion @davanstrien. I opened https://github.com/huggingface/huggingface_hub/pull/1695 to add it.

maybe pin this as instruction in the GH issues and/or even in the README! i think many community members will be interested


importccl: support IMPORT INTO for DELIMITED and PGCOPY

PR: https://github.com/cockroachdb/cockroach/pull/52628
From release notes:

IMPORT INTO is now supported for DELIMITED and PGCOPY file formats. [#52628][#52628] {% comment %}doc{% endcomment %}

PGCOPY can only include data for one table

Just don't doc PGCOPY for now. We should with delimited


Fixed #6205 -- Require "Change advanced settings" permission to change template

Fixed #6205

Coverage remained the same at 82.794% when pulling 6935f5d83b5d1ec5e9deafcaa01f7ca80f5aa202 on czpython:fixes/3.4.x/6205 into 5422ff0013e07e236bcd1d9490011c87f562b5a2 on divio:release/3.4.x.


Adding COC token

Please review the following token assets:
📑 Description
CryptoOracle Token On Base

Token Name: COC
Project Website: https://cryptooracle.io/
Explorer URI: https://basescan.org/token/0xe2b21d4684b2ba62f3be1fe286eacb90d26e394d

✅ Checks

[x] I created a new folder with the token address, all in lowercase
[x] I added the token's logo as a 32x32 PNG file, named logo-32.png
[x] I added the token's logo as a 128x128 PNG file, named logo-128.png
[x] I added the token's logo as a SVG file, named logo.svg
[x] All the tests have passed

Done!
https://www.cryptooracle.io/coc-token


Remove version: Google.Chrome.Canary version 131.0.6755.0

installers return following HTTP status code: 404
Microsoft Reviewers: Open in CodeFlow

URL: https://dl.google.com/release2/chrome/ad7dcal4fa2vcexcnzxgx73vxepa_131.0.6755.0/131.0.6755.0_chrome_installer.exe
Response status code does not indicate success: 404 (Not Found).
(Automated message - build 897)


Add "list" and  "ssh" actions

This is a follow up after(based on) https://github.com/pvoborni/aiohabit/pull/7
List action
To quickly show content of DB in human readable form
SSH action
To make it very easy to SSH into a host based on value in various  configuration objects.
It is usually very time-consuming to "cat" e.g. inventory, copy the real hostname/IP, write all the SSH options including determining if it should use SSH key and what is its location.
The interactive mode even saves time with writing the fake hostname.
The bad UX of these actions is a need to provide metadata/config paths. In some other PR, we should figure out some reasonable default so that ppl can simply execute: aiohabit list and aiohabit ssh

@pvoborniEverything looks good, but I have two considerations (which I want to fill bugs for):

There's a bug in AWSProvider.to_host method that is breaking the SSH action: https://github.com/pvoborni/aiohabit/blob/97f482e2e9338c618fdec42bb2f4970057725976/src/aiohabit/providers/aws.py#L216
That should line must be replaced by:

STATUS_MAP[host_info.get("status")],

This could be done in this PR, but we also need to better map the statuses among providers.

We could improve the names of the classes to reflect what they do, like rename all action classes to SomethingAction, e.g: SSHAction, ListAction.

Also, I couldn't ssh into AWS hosts, I tried to force the private key without success. Since I don't think that's related to the changes you are providing, I'm fine with all here.

Thanks Armando for the review. I agree with both points.


Minor typo fixes

I'm done for today! Spell & typo checked the whole guide and adjusted minor parts.
I also found working copies of the manual and the other PDF and hosted them on my server, so we can bundle them into the material or link there (The adobe page links are 404 for me)

Interesting that the links aren't working for you.


Roman/feature/staging

Travis automatic deployment: https://86-pr-ching.surge.sh

@pycckuu please approve


Filter throw unorderable type error

This happens when a filter is referring to a column that has been discharded earlier, i.e. an original column that is not being used in the columns. Then the filter treats the columname as string and can't compare it to any values.
Is this behaviour intended?

No, that is an issue. Just like columns, filters should communicate the columns that they need to the evaluation, such that all necessary columns are present when the filter is invoked.

Can you create a minimal working example how you discovered it?

Run the miplip benchmark logfiles with this eval-file:

Which eval-file?


shared/api: Consistent file names

The files under shared/api should be named after their API paths with
the one difference that when a collection, the singular should be used.
/1.0/storage-pools => storage_pool.go
/1.0/storage-pools/POOL/volumes => storage_pool_volume.go
Signed-off-by: Stéphane Graber<EMAIL_ADDRESS>

Right, thanks!


encryption: remove duplicate comments

ref #17410.
As the title says.

What is changed and how it works?

Issue Number: ref #17410

What's Changed:
Comments

Related changes

[ ] PR to update pingcap/docs/pingcap/docs-cn:
[ ] Need to cherry-pick to the release branch

Check List
Tests

[ ] Unit test
[ ] Integration test
[ ] Manual test (add detailed scripts or steps below)
[x] No code

Side effects

[ ] Performance regression: Consumes more CPU
[ ] Performance regression: Consumes more Memory
[ ] Breaking backward compatibility

Release note

none

/cc @glorv @LykxSassinator

/test pull-unit-test

/ok-to-test


Docs - Pkg.add("Luxor") not Pkg.add("Luxor.jl")

Good one! You can tell I've only just registered it!

Fixed by https://github.com/cormullion/Luxor.jl/commit/22d83c637a93f0991a50bdf5656f5862a3d9f22e.


prediction code?

how get the output vector from a picture？can you provide the prediction codes?  thank you

To get face feature from original image, you need a few steps:

mtcnn for face detection and alignment.
use net(face_image)  to get fc output
compute feature = nd.L2Normalization(fc).astype("float32").asnumpy()

Use this feature for face verification or identification.

thanks


Removed unsupported dev langs.

Task for removing unsupported languages from ``` auto complete.

Hi @bharney0,
This is actually incorrect now and will introduce issues. The list that was provided in the task is incorrect and missing languages that are actually supported. For example, at a glance you're removing all the valid interactive dev langs. Every single interactive dev lang that was listed is actually fully supported by the platform. Let's have a discussion before this change is merged, please.

@IEvangelist I agree. We should have more of a discussion about what languages can be removed before doing anything. At this point, its not a big deal if there are more languages, the user can always search in the list. @meganbradley @adunndevster @jamarw

@IEvangelist as per @adkinn advice, we should use our current taxonomy that is supported by the system and not the list in the highlightjs code. If devlangs should be added to the list we can make requests to the IA team.
@adunndevster Should I go ahead and merge this?

@IEvangelist as per @adkinn advice, we should use our current taxonomy that is supported by the system and not the list in the highlightjs code. If devlangs should be added to the list we can make requests to the IA team.
@adunndevster Should I go ahead and merge this?

I'm sorry, but @adkinn is incorrect. The platform supports interactive, and you're removing that. Which is wrong.

@IEvangelist that's such a sweeping statement. It's not incorrect to remove all of the devlangs not in our taxonomy. Keeping the interactive modifier is not a bad idea.
@bharney0 I think it makes sense to maintain the "interactive" modifier tags. Let's keep those and remove the rest.  Additionally we can update our taxonomy script to output this list when we make changes on the source of truth.

Hi @adkinn and @bharney0,
In production today
Call me customer-obsessed... but, there are other languages being removed that are in fact supported, besides just the interactive ones the taxonomy list that you have is still incomplete. At a glance, I initially noticed that the interactive ones were missing - I happy I looked deeper.
For example, in production today on the docs.microsoft.com/azure site we're using the following dev langs, that you're attempting to remove (however, these are work correctly):

Dev Lang
Link(s)
Image from PROD

apache, apacheconf
1, 2

gradle
1, 2, 3

groovy
1, 2, 3

kotlin
1, 2, 3

ini
1, 2, 3

nginx
1

properties
1, 2

terraform, tf, hcl,
1, 2

Other dev langs that are in the wild today, that I was too lazy to dig up the proof of their existence / usage -- but trust me they are being used and correctly syntax highlight.

PostgreSQL & PL/pgSQL: pgsql, postgres, postgresql
Shell: shell, console (actually we need to discuss this one)

Plaintext
Please leave this one too, as it is a unified way of communicating a desire for a code-fence to have structured text - but no highlighting.

Name
Dev lang

Plaintext no highlight
plaintext

Interactive dev langs

Name
Dev lang

Azure CLI (Interactive)
azurecli-interactive

Azure PowerShell (Interactive)
azurepowershell-interactive

C# (Interactive)
csharp-interactive

MS Graph (Interactive)
msgraph-interactive

PowerShell (Interactive)
powershell-interactive

My opinion is that there should be a small group discussion about this PR before merging. In quickly scanning through the list of dev langs to be removed, I noticed a handful that my team uses. It's an impactful change that's likely to affect many other content developers.

@IEvangelist @scottaddie yes they are many languages that are not in our taxonomy yet. This PR will not remove support for this languages.
This PR is an effort to reconcile our linting hints with our taxonomy. We can add new devlangs to the taxonomy to update it in the future.

FYI folks, as long as we are open to adding more languages to the taxonomy (as per Adam: "We can add new devlangs to the taxonomy to update it in the future."), then this change doesn't break anybody. I saw my name used at the beginning, and was going to say that the correct guidance of supported languages is https://review.docs.microsoft.com/en-us/help/contribute/code-in-docs?branch=master#supported-languages but someone has added to that list and made it inaccurate. For example, we don't want people using both cs and csharp for C#, only csharp for consistency. In many cases, just because an alias is supported in highlight.js, we won't change that into the proper friendly name and we'll end up with an inconsistent user experience. Also, just because a language is in highlight.js doesn't mean it is supported. It will work, but if decide at some point to change our highlighting provider it may not. That list should be the languages that are actively being used on Docs, with the chosen single alias, not just a dump of every language from a specific open source highlighting project.

Hi @DuncanmaMSFT,
Thank you for speaking up, you said:

then this change doesn't break anybody

Let me explain how this does in fact break consumers. Removing certain things from the statement completion list will cause warnings for developers, who are using identifiers not in this list (false negatives) and the tool will instruct them to change the dev lang, as it would then be unrecognized. Thus, making this a breaking change. If we have code snippets that show nginx for example, and it has the correct syntax highlighting... it is valid. Removing it from the list, will cause issues and confuse users of the DAP extension.
If the platform supports, we want to guide the content developers (and external contributors) down a path of success and show them what valid options are available to them. I hear you, that we can update one of the several, master lists but we need alignment on what the list is. I've been asking multiple folks for this information for a while now, and decided to take action.

That list should be the languages that are actively being used on Docs, with the chosen single alias, not just a dump of every language from a specific open source highlighting project.

I agree that we shouldn't just dump every language that is supported by highlightjs into the docs, but what is the appropriate list -- have you ran audits on docsets, do you know all the dev langs? I have done this on the Azure repo and know what is being used, several of which this PR is trying to remove.

For example, we don't want people using both cs and csharp for C#, only csharp for consistency.

I agree, the tool today works with csharp but it will not warn people who are using cs as it is technically valid and they both render the exact same, i.e.; the syntax highlighting is accurate and the label is C#. The first alias is used by the tool when inserting a dev lang, the other aliases are then to ensure that a dev lang is not invalid. I too want consistency and this tool gets us much closer to having that.

@DuncanmaMSFT @adkinn @IEvangelist @scottaddie 13 languages have been added back to the list which includes the 8 being used in azure docs, in addition to the 5 interactive ones. Let me know when we have a more comprehensive list so we can get it updated.

This looks good, thank you @bharney0!
You'll need to also update the package.json to correct the schema to reflect these changes. Unfortunately the JSON schema is still a separate list for now. See here. After that is done and when this gets pushed out, several docset repos will have to correct their local settings.json file to match the names for their workspace scoped makrdown.docsetLanguages. /cc @scottaddie FYI about this last point...

This looks good, thank you @bharney0!
You'll need to also update the package.json to correct the schema to reflect these changes. Unfortunately the JSON schema is still a separate list for now. See here. After that is done and when this gets pushed out, several docset repos will have to correct their local settings.json file to match the names for their workspace scoped makrdown.docsetLanguages. /cc @scottaddie FYI about this last point...

Thanks for letting me know. I've updated the package.json as well.

Heads up that our C++ docs do use both the ARM assembler and Makefile dev langs. Are we sure those should be removed? See https://github.com/MicrosoftDocs/cpp-docs/blob/ef8836e9deb10f0b18ac1d4d043cb65ae0e51735/.vscode/settings.json#L6-L16.

@scottaddie I'm fine with including those since they are being used in C++ docs, @adkinn any objection?


Better type detection for inference of column matrix

@coleslaw @williaster

@bkyryliuk

Coverage increased (+0.04%) to 72.699% when pulling ebe4ee2c41d2e4e6a0b52163d9b252a458b85bc9 on type_detect into 4b48e9f1e9c5a4d2474f487d816b58c52accf821 on master.


have a true JSON output

if I do
var command = new Ansible.AdHoc().module('setup').hosts('localhost');
var promise = command.exec();
The result isn't directly parseable as json
by example output begin by
 localhost | SUCCESS => {
    "ansible_facts": {
        "ansible_all_ipv4_addresses": [
            "<IP_ADDRESS>",
            "<IP_ADDRESS>"
        ],

If you are running a playbook you can use the json callback.  For ad-hoc execution there is no way to use a custom callback yet (see https://github.com/ansible/ansible/issues/16194).

Hi,
Can you please provide an example how to get an json output?
If I run playbook like bellow I get nicly formated ouput if ansible.cfg does have stdout_callback = json enabled:
ansible-playbook list_sipxcom.yml
{
"plays": [
{
"play": {
"id": "70835ad3-1fe7-403********a",
"name": "localhost"
},
"tasks": [
{
"hosts": {
"localhost": {
"_ansible_no_log": false,
"changed": false,
"instances": [
{
],
"stats": {
    "localhost": {
        "changed": 0,
        "failures": 0,
        "ok": 1,
        "skipped": 0,
        "unreachable": 0
    }
}

}
but running nodejs command i get this output that I dont know how to parse it as json
node mock.js
[WARNING]: provided hosts list is empty, only localhost is available
PLAY [localhost] ***************************************************************
TASK [Basic provisioning of EC2 instance] **************************************
ok: [localhost]
PLAY RECAP *********************************************************************
localhost                  : ok=1    changed=0    unreachable=0    failed=0
Thanks,

mock.js is this:
var fs = require('fs');
var Ansible = require('node-ansible');
var command = new Ansible.Playbook().playbook('./ansible/list_sipxcom');
command.on('stdout', function(data) { console.log(data.toString()); });
command.on('stderr', function(data) { console.log(data.toString()); });
command.exec();

Just started messing around with this project myself. This works for me (you can either hack the code or just export the env vars before launching:
ANSIBLE_LOAD_CALLBACK_PLUGINS=1
ANSIBLE_STDOUT_CALLBACK=json


Bubbletree error R packages missing

Follow up to #1229
Bubbletree directory is now being created with these contents:
root@51853b033dc8:/data/CNV.valid/P1/work/heterogeneity/T1/bubbletree# ls -l
total 1284
-rw-r--r-- 1 root root     147 Dec 12 23:50 T1-cnvkit-prep.csv
-rw-r--r-- 1 root root    2576 Dec 12 23:50 b1-vepeffects-annotated-vardict-prep-run.R
-rw-r--r-- 1 root root 1306453 Dec 12 23:50 b1-vepeffects-annotated-vardict-prep.csv
root@51853b033dc8:/data/CNV.valid/P1/work/heterogeneity/T1/bubbletree#

but some packages appear to be missing:
[2017-12-12T23:50Z] Error: package or namespace load failed for 'GenomeInfoDb' in loadNamespace(i, c(lib.loc, .libPaths()), versionCheck = vI[[i]]):
[2017-12-12T23:50Z]  there is no package called 'GenomeInfoDbData'
[2017-12-12T23:50Z] Error: package 'GenomeInfoDb' could not be loaded
[2017-12-12T23:50Z] Execution halted
[2017-12-12T23:50Z] Uncaught exception occurred
Traceback (most recent call last):
  File "/usr/local/share/bcbio-nextgen/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 23, in run
    _do_run(cmd, checks, log_stdout, env=env)
  File "/usr/local/share/bcbio-nextgen/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 103, in _do_run
    raise subprocess.CalledProcessError(exitcode, error_msg)
CalledProcessError: Command 'set -o pipefail; unset R_HOME && unset R_LIBS && export PATH=/usr/local/share/bcbio-nextgen/anaconda/bin:$PATH && /usr/local/share/bcbio-nextgen/anaconda/bin/Rscript /data/CNV.valid/P1/work/heterogeneity/T1/b
ubbletree/b1-vepeffects-annotated-vardict-prep-run.R

I installed it manually like so:
set -o pipefail; unset R_HOME && unset R_LIBS && export PATH=/usr/local/share/bcbio-nextgen/anaconda/bin:$PATH && /usr/local/share/bcbio-nextgen/anaconda/bin/R
and ran the following in R:
source("https://bioconductor.org/biocLite.R")
biocLite("GenomeInfoDbData")

and then re-ran the pipeline, which resulted in this (new) error:
[2017-12-13T09:37Z] The following objects are masked from 'package:plyr':
[2017-12-13T09:37Z]     arrange, count, desc, failwith, id, mutate, rename, summarise,
[2017-12-13T09:37Z]     summarize
[2017-12-13T09:37Z] The following objects are masked from 'package:GenomicRanges':
[2017-12-13T09:37Z]     intersect, setdiff, union
[2017-12-13T09:37Z] The following object is masked from 'package:GenomeInfoDb':
[2017-12-13T09:37Z]     intersect
[2017-12-13T09:37Z] The following objects are masked from 'package:IRanges':
[2017-12-13T09:37Z]     collapse, desc, intersect, setdiff, slice, union
[2017-12-13T09:37Z] The following objects are masked from 'package:S4Vectors':
[2017-12-13T09:37Z]     first, intersect, rename, setdiff, setequal, union
[2017-12-13T09:37Z] The following objects are masked from 'package:BiocGenerics':
[2017-12-13T09:37Z]     combine, intersect, setdiff, union
[2017-12-13T09:37Z] The following objects are masked from 'package:stats':
[2017-12-13T09:37Z]     filter, lag
[2017-12-13T09:37Z] The following objects are masked from 'package:base':
[2017-12-13T09:37Z]     intersect, setdiff, setequal, union
[2017-12-13T09:37Z] Loading required package: magrittr
[2017-12-13T09:37Z] Warning messages:
[2017-12-13T09:37Z] 1: Installed Rcpp (0.12.13) different from Rcpp used to build dplyr (0.12.10).
[2017-12-13T09:37Z] Please reinstall dplyr to avoid random crashes or undefined behavior.
[2017-12-13T09:37Z] 2: no function found corresponding to methods exports from 'DelayedArray' for: 'acbind', 'arbind'
[2017-12-13T09:37Z] 3: no function found corresponding to methods exports from 'SummarizedExperiment' for: 'acbind', 'arbind'
[2017-12-13T09:37Z] 4: multiple methods tables found for 'rglist'
[2017-12-13T09:37Z] 5: multiple methods tables found for 'Ontology'
[2017-12-13T09:37Z] 6: replacing previous import 'AnnotationDbi::Ontology' by 'BiocGenerics::Ontology' when loading 'GenomicFeatures'
[2017-12-13T09:37Z] Error in .normargSEW0(start, "start") :
[2017-12-13T09:37Z]   'start' must be a numeric vector (or NULL)
[2017-12-13T09:37Z] Calls: GRanges ... new_GRanges -> IRanges -> solveUserSEW0 -> .normargSEW0
[2017-12-13T09:37Z] Execution halted
[2017-12-13T09:37Z] Uncaught exception occurred
Traceback (most recent call last):
  File "/usr/local/share/bcbio-nextgen/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 23, in run
    _do_run(cmd, checks, log_stdout, env=env)
  File "/usr/local/share/bcbio-nextgen/anaconda/lib/python2.7/site-packages/bcbio/provenance/do.py", line 103, in _do_run
    raise subprocess.CalledProcessError(exitcode, error_msg)
CalledProcessError: Command 'set -o pipefail; unset R_HOME && unset R_LIBS && export PATH=/usr/local/share/bcbio-nextgen/anaconda/bin:$PATH && /usr/local/share/bcbio-nextgen/anaconda/bin/Rscript /data/CNV.valid/P1/work/heterogeneity/T1/bubbletree/b1-vepeffects-annotated-vardict-prep-run.R

I've put the entire contents of the bubbletree directory online for your review here:
https://www.dropbox.com/sh/ek23vmjjphrsui0/AADrHfKeG3rTSmoH7QUFmNXra?dl=0

Thank you for this report and for your patience. Apologies for missing this earlier. I've pushed fixes which resolve both of these issues: the conda package now depends on bioconductor-genomeinfodbdata and the bcbio code more flexibly handles input CNVkit files. In this case the T1-cnvkit-prep.csv file from CNVkit is problematic because the input cns file was not in the expected order. I've fixed this by not requiring an ordering of columns and instead using the header. If you remove that file from your bubbletree directory and re-run in place it should hopefully do the right thing now and generate a correct file.
Thank you again for the report and hope this gets your analysis finished.


Exif metadata gone after save to gallery

Please keep exif metadata.

@anggiedwarsa any workaround?
I need the same:) I want to save to gallery with the modified exif date (or lastModifiedDate on the xfile), but in the gallery it is always the current time


Increment static IP Address

I'm having an issue setting incremental IP address' in Terraform.
The error I'm getting is;
Error: 400 Parameter verification failed.
{"errors":{"ipconfig0":"invalid format - format error\nipconfig0.ip: invalid format - value does not look like a valid ipv4 network configuration\n\n"},"data":null}
The code used to set the incremental static IP is
  ipconfig0 = "ip=<IP_ADDRESS>${count.index + 1}/22,gw=<IP_ADDRESS>"
I have tested this code block with setting the IP using DHCP, with no issues
    ipconfig0 = "ip=<IP_ADDRESS>/22,gw=<IP_ADDRESS>"
I've seen many a lot of examples online using this format and having no errors. Is this something which has potentially been deprecated?
Thanks,
Mark

Hi, the IP that you're generating is not a valid IP, read carefully what ip you're trying to pass


Web Components 101 series

Hello! I want to suggest adding Web Components 101: What are Web Components? to the list of introductory articles. WDYT?

Hi, sounds good to me. Feel free to submit a PR 👍


feat(eth-sender): add eth_sender_lock table i.e exclusive locks in eth-sender

is the sole purpose of this to avoid running two instances of eth-sedner?


hq servers not working anymore?

logged some ppl and they had admin perms or even owner on 1k+ servers but it did not show up in the embed

I fixed the issue in the code because I don't like my code not working, but it wasn't to help you. Please never claim you used my tool for malicious purposes again.

ok thx


Using the svelte field in package.json to point at .svelte source files is deprecated

The following warning is shown when running npm run dev.
[vite-plugin-svelte] WARNING: The following packages have a svelte field in their package.json but no exports condition for svelte.
<EMAIL_ADDRESS>Please see https://github.com/sveltejs/vite-plugin-svelte/blob/main/docs/faq.md#missing-exports-condition for details.

The fix seems pretty easy


'UIAWrapper' object has no attribute 'is_active'

I got the error while trying to run dlg.Wait.
import os
from pywinauto.application import Application
from pywinauto.sysinfo import is_x64_Python

wpf_samples_folder =  r"apps\WPF_samples"
if is_x64_Python():
    wpf_samples_folder = os.path.join(wpf_samples_folder, 'x64')
wpf_app_1 = os.path.join(wpf_samples_folder, u"WpfApplication1.exe")
app = Application(backend = 'uia').Start(wpf_app_1)
dlg = app.WPFSampleApplication

dlg.Wait('active')

Edit: fix the code to reproduce the error

Should we add to UIAWrapper a simple implementation of is_active method like following?
    #-----------------------------------------------------------
    def is_active(self):
        """Whether the window is active or not"""
        return (self.is_visible() and self.is_enabled())

active is not the same as visible+enabled. We need to find UIA functionality similar to GetActive for native windows.

Quoted from above

We need to find UIA functionality similar to GetActive for native windows.

I am wondering if there is some mechanism in pywinauto that doing the same as WinActivate (in AutoHotKey) to Activates the specified window (makes it foremost)
Is this feature not implemented from win32 SetActiveWindow, or there are some technical issue for it?
By the way, as an 8-year fan of AutoHotKey and 3-week new comer on Python, I really love the implementation of pywinauto

Hi @Eucaly. With the UIA branch we introduced a new concept of 'back ends'. This is to allow the GUI automation by using different available mechanisms. The uia back end, for example, implies working with MS UI Automation technology, without involving direct calls to Win32 API while the automation based on pure Win32 API calls now is incorporated into the native back end.  Trying to stick to UI Automation is the main reason for opening this issue. We wanted to find a UI Automation equivalent to SetActiveWindow. @Eucaly, you can see my implementation for UiaWrapper.is_active method in PR #213. Any thoughts about it are always welcome.

Hi @airelil , thanks for quick response. My project (that uses pywinauto) is target for a floating bar to help different programs to do some scripting. (Just implement the early 5% concept proto, not on Github yet). Maybe named bZmenu
I have another UIA project (in c# AutomationElement) bZmd to preview markdown files, when editing with (virtually) any editors. But that is a passive role (monitoring windows), rather than operate them.
Do have some thought to port bZmd to pyQt5, but it seems pyQt webbrowser has some incompatible migration recently (QtWebKit, QtWebKitWidgets, QtWebEngineWidgets).
I will keep watching UIA/AutomationElement both from c# and Python.

I am wondering if there is some mechanism in pywinauto that doing the same as WinActivate (in AutoHotKey) to Activates the specified window (makes it foremost)

Hi @Eucaly , for Win32 API backend (pywinauto 0.5.4) you can use method SetFocus() that will be renamed to set_focus() in 0.6.0 (though native backend will support old deprecated name). Say app.TopLevelDialog.SetFocus() will bring the window to top.

Hi @vasily-v-ryabov , thanks for the clear instruction. It works now by using .SetFocus()


added opcodes: SHL, SDIV, SMOD

thanks a bunch! I'll take a look at the conflict, someone else picked up SHL

I like the way you convert uint > int, I used it for my pull request too, but why did you use & MAX_UINT256 instead of % 2**256?

I like the way you convert uint > int, I used it for my pull request too, but why did you use & MAX_UINT256 instead of % 2**256?

force of optimisation habbit. redundant calculation, supposedly faster. I'm not married to it

force of optimisation habbit. redundant calculation, supposedly faster. I'm not married to it

Cool, I didnt know that. Thanks for the info.


Kubernetes monitoring dashboard does not show pods metrics

Kubernetes monitoring dashboard works great in general but it does not show pod related information. It appears that there is no label name associated with the metric which starts with k8s_. As a result no time series data is returned. Can you share why are we expecting the pod name to start with k8s_?

@muzammil360 you are right, i think this is dsnt make sense... can you make a PR to fix?


Can you share example CIC prompts for RAG and SQL ?

Hi,
I am reimplementing the benchmark using the dataset you already released. Could you provide the CIC prompts for the SQL and RAG retrieval tasks?
They were not clearly outlined in the paper.
If you are planning to release the code soon, I can wait. However, if it might take a while, could you possibly share an example for each task? 😄
Thanks for your work! 👍

Hi Emilien, thanks for checking out our paper! We will be releasing the evaluation code along with example prompts shortly, stay tuned!

Any update on this? @anthonywchen


Introduce script to find and compare differences between two releases

#1338

Codecov Report

Merging #1405 into master will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master    #1405   +/-   ##
=========================================
  Coverage     74.14%   74.14%
  Complexity     1930     1930
=========================================
  Files           324      324
  Lines          5105     5105
  Branches        945      945
=========================================
  Hits           3785     3785
  Misses          770      770
  Partials        550      550

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bb3a4f7...492e2f5. Read the comment docs.


client request of supporting connects to Server via http / socks proxy

Hi,
This request is about the KCP client. Because my laptop at company connects to internet via a http proxy.  It has no direct connection to internet. So I  am requesting clients to support http/ socks proxy just like SSR client does.

Thanks!

请求客服端增加支持http socks代理连接server的功能。

It's completely impossible. you have to do some kind of Relaying.

OK， Thanks for your comments.


Legacy table for anatomical MRI data

Fixes issue #55 and issue #54.

So this would be what we call a "grouping"-suffix: so it could be
sub-01_echo-1_PDT2.nii.gz for the PD-weighted one and
sub-01_echo-2_PDT2.nii.gz for the T2-weighted one. What do you think?
On Fri, Aug 16, 2019 at 4:21 PM Thomas Nichols<EMAIL_ADDRESS>wrote:

@nicholst commented on this pull request.
In ProposedChangesToSpecification.md
https://github.com/bids-standard/bep001/pull/58#discussion_r314741416:

+## Legacy suffixes for anatomical data
+### Proposed Change
+Moves some suffixes for anatomical data to a new table called "LEGACY suffixes". These suffixes are still valid BIDS format,
+but we reccomend not to use them anymore. They are ambiguous and/or inconsistent.

+### Justification
+The following suffixes are moved to the legacy table:

_T2star: what is meant is T2*-weighted data. To be consistent with the suffixes T1w, T2w and PDw, we want
+to use the suffix _T2starw for this.

_FLAIR: This is a sequence name rather than a contrast or a way of grouping quantitative maps. We prefer to use
+_T2w, _PDw, or _MESE depending on the use case.

_FLASH: This is a sequence name rather than a contrast or a way of grouping quantitative maps. We prefer to use
+_T2starw, _PDw, or _GREME depending on the use case.

_PD: what is meant is PD*-weighted data. To be consistent with the suffixes T1w, T2w and T2starw, we want
+to use the suffix _PDw for this.

_PDT2: We recommend to use PDT2map for this.

@agahkarakuzu https://github.com/agahkarakuzu, @Gilles86
https://github.com/Gilles86 and I are just reviewing this pull request
and wondering about whether this scan is one file (maybe with two volumes
in it - in the 4th dimension) or two files? Or are the two echos combined
in someway to one 3D file?
IMHO, the PDT2 suffix only makes sense for a 2-volume image... if the
images are separated out, then one would be _PD and the other _T2.
However, heudiconv presently uses it with 3D images too: dcm2nii
creates 2 3D images, but heudiconv uses a logic that requires images
sharing a DICOM Series UID to share a BIDS base and image type; so since
both the PD and T2 arise from the same series, they get the same base and
then must be distinguished with (e.g.) echo-1 and echo-2.
Does this help?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/bids-standard/bep001/pull/58?email_source=notifications&email_token=AAIPRTWKYGSTOY3MG4BN6KTQE2ZWTA5CNFSM4HQM6RIKYY3PNVWWK3TUL52HS4DFWFIHK3DMKJSXC5LFON2FEZLWNFSXPKTDN5WW2ZLOORPWSZGOCBZRN2A#discussion_r314741416,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIPRTW7UIGQZ7OUG5FUM33QE2ZWTANCNFSM4HQM6RIA
.

--
Gilles de Hollander
Postdoctoral Researcher
University of Zurich
Department of Economics
website http://www.gillesdehollander.nl/ | github
https://github.com/Gilles86/

So this would be what we call a "grouping"-suffix: so it could be sub-01_echo-1_PDT2.nii.gz for the PD-weighted one and sub-01_echo-2_PDT2.nii.gz for the T2-weighted one. What do you think?

Yup!  This is what I was thinking.
Of course, if it is a 4D file of length 2 that it is assumed PD is the first volume and and T2 is the second, both in sub-01_PDT2.nii.gz.

Of course, if it is a 4D file of length 2 that it is assumed PD is the
first volume and and T2 is the second, both in sub-01_PDT2.nii.gz.

To remain consistent, keep things overseeable for developers and users, and
don't have json key-value pairs that can either be lists or scalars, we for
opted to never have 4D-images in anatomical data... It can be a bit more
work when preparing data sets,  but it keeps things a lot less messy along
the line. What do you think, Thomas?
On Fri, Aug 16, 2019 at 4:57 PM Thomas Nichols<EMAIL_ADDRESS>wrote:

So this would be what we call a "grouping"-suffix: so it could be
sub-01_echo-1_PDT2.nii.gz for the PD-weighted one and
sub-01_echo-2_PDT2.nii.gz for the T2-weighted one. What do you think?
Yup! This is what I was thinking.
Of course, if it is a 4D file of length 2 that it is assumed PD is the
first volume and and T2 is the second, both in sub-01_PDT2.nii.gz.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/bids-standard/bep001/pull/58?email_source=notifications&email_token=AAIPRTWMFX6RHCCENCPOLE3QE2535A5CNFSM4HQM6RIKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD4O26LA#issuecomment-522039084,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIPRTQBGS33HU7PXCTNXBDQE2535ANCNFSM4HQM6RIA
.

--
Gilles de Hollander
Postdoctoral Researcher
University of Zurich
Department of Economics
website http://www.gillesdehollander.nl/ | github
https://github.com/Gilles86/

Ruling out 4D structural data sounds fine to me!  FWIW, I haven't seen dcm2niix/heudiconv ever create 4D PDT2 files.

Cool. Thanks for the feedback!
On Fri, 16 Aug 2019, 22:42 Thomas Nichols<EMAIL_ADDRESS>wrote:

Ruling out 4D structural data sounds fine to me! FWIW, I haven't seen
dcm2niix/heudiconv ever create 4D PDT2 files.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/bids-standard/bep001/pull/58?email_source=notifications&email_token=AAIPRTTZYAWHFY47K2J2QNLQE4GL7A5CNFSM4HQM6RIKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD4PU2EY#issuecomment-522145043,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAIPRTQOTCRM2NLMAEAAM3DQE4GL7ANCNFSM4HQM6RIA
.


Fix 556

Description
No package-lock was needed because in the project yarn it's used, so i deleted it, generated the correct yarn.lock files.
I generated them after solving the audit issue about nth-check setting the version which yarn needs to solve in the "resolutions" part of the package.json files.
While recompiling with "npm run dev" i also noticed the package.json were missing nodemon in the "devDependencies" section so i fixed that too, and after another "yarn" i was able to run the solution successfully.
Issue reference
We strive to have all PRs being opened based on an issue, where the problem or feature have been discussed prior to implementation.
Please reference the issue this PR will close: #556
Checklist
Please make sure you've completed the relevant tasks for this PR, out of the following list:

[x] The quickstart code compiles correctly
[x] You've tested new builds of the quickstart if you changed quickstart code
[x] You've updated the quickstart's README if necessary
[x] If you have changed the steps for a quickstart be sure that you have updated the automated validation accordingly. All of our quickstarts have annotations that allow them to be executed automatically as code. For more information see mechanical-markdown. For user guide with examples see Examples.

For the FE part that i changed, i re-tested locally and everything seems ok:
dapr init
cd to react-calculator
npm install
npm run buildclient
dapr run --app-id frontendapp --app-port 8080 --dapr-http-port 3507 node server.js
As specified in the tutorial here: https://github.com/MACEL94/fix-556/tree/fix-556/tutorials/distributed-calculator#running-the-quickstart-locally

@yaron2 let me know if I need to add any info or change something, thanks

Thank you much.  I'm looking into why the first check failed, and once we rerun that we can merge this.

@yaron2 @paulyuk  I believe this PR now also solves the failing tests problem, can i ask you to re-launch the tests? thank you

@paulyuk sorry to see there are still problems, my bad for not trying in the devcontainer before pushing(I didn't notice the .devcontainer folder).
Will try again locally as soon as I have time and get back to you

Tomorrow I will try but I think at this point I'm just missing match_order: none

Hi @paulyuk @greenie-msft
I looked into it and we can add
"match_order: none" but that would not guarantee that the order specified(for example the 11) was correctly persisted(maybe another one was).
I'd suggest to add that but also to change the second log from

"Successfully persisted state."
to something with the id in it like
"Successfully persisted state for Order ID: " + orderId

Because the important part here is just that the order was received and then correctly persisted, it doesn't matter if the log in the meantime do anything else.
Let me know your opinion, and if you agree I can pick this up and solve it.

Hi @paulyuk @greenie-msft  @yaron2
if you're ok with the change please take this PR and re-publish the samples images, then i expect the test to pass.
It's not so straightforward for me to test the PR if i changed something in the code because the tests only use the published images on your official ghcr for how the pipelines are structured.
But i assume this is intended so let me know if you need me to test in any other way.

@MACEL94 thanks for the contributions!
One idea that I had to test these changes before merging into master is to create a new branch (in the quickstart repo) and target this PR at that branch.
We would then add the new branch into this list that automatically publishes new images: https://github.com/dapr/quickstarts/blob/master/.github/workflows/build.yml#L18
What do you think about that? Would that be an easy way to test your changes before merging into master?

@greenie-msft
yes that would help me!
No problem for me creating another PR to target the other branch :)
feature/556-tutorials-fix maybe?
Thank you

@MACEL94 Branch is created and the workflow has been updated to run on changes to the branch. Please open the PR targeting https://github.com/dapr/quickstarts/tree/feature/556-tutorials-fix and let's see if the tests pass.
Thank you!

@MACEL94 - Did you get the tests to run successfully?

Hi @msfussell I tagged you in #771 explaining why right now they can't pass. I changed part of the code that needs to be build and published before the tests can pass(as the tests use the latest image published, not the actual source code).
Before they can pass the other pr(#771) needs to be merged so that the new images are published with the ID in the log message when the order is processed.
Let me know if I didn't explain well what I meant

#771 is in, pending that we do this.

Hi @paulyuk
this was primarily opened to fix the #556 issue, so i think could/should still be merged.
If you want me to undo the changes i made to the readme files instead I can, i understood they're not needed anymore.


What estimator should I use?

Hello!
I need some advice about the two main characteristics of my problem.

What is the more suitable estimator for my problem?

I have daily record data with one target and 28 other related variables. Sice, I don't know in advance the values of related variables, and knowing that each variable depends not only on its past values but also has some dependency on other variables, what estimator is more suitable for my problem? GPVAREstimator?

My data doesn't have weekend records, only weekdays records! What should I do related to the time-frequency?

Do I need to change the freq or should I set as "D"?
Thank you!

(1) you have two choices: either you choose a multi-variate model (e.g., https://gluon-ts.mxnet.io/api/gluonts/gluonts.model.deepvar.html as an alternative) or you pick a seq2seq model where you don't have to have the feature/co-variates in the forecast horizon: https://gluon-ts.mxnet.io/api/gluonts/gluonts.model.seq2seq.html
(2) you can do "daily" and then mark the values as missing/NaN during weekends and add a binary indicator co-variate to indicate it's weekend. But maybe there's a workday granularity as well, that I'm not aware of.

@timoschowski Thank you!
In what kind of problem should I use GPVAREstimator instead of DeepVAREstimator?

Gaussian Process models are something that would require something failry smooth, I'd say -- and the implementation may not be as well-tuned, I think. In general, the multi-variate models aren't as far implementation-wise, so you'll have to adjust your expectations.

@timoschowski Thank you for your help. Do you have any example of end-to-end implementation of seq2seq models?
Thank you!


Update relationships in Agri models to use verb attributes

Issues #528 and #534

please rebase your work to fix the build, as now the problem with the URL has been fixed


False positive for ARG001; unused function argument

A minimal code snippet that reproduces the bug.

from typing import Any, cast

def _identity(x: None) -> None:
    return x

def f(x: None) -> None:
    """Raises ARG001 Unused function argument: `x`."""
    _ = cast(Any, _identity)(x=x)

def g(x: None) -> None:
    """Does not raise anything."""
    _ = cast(Any, _identity)(x)

The command you invoked (e.g., ruff /path/to/file.py --fix), ideally including the --isolated flag.

> ruff --isolated --select ARG001 foo.py
foo.py:8:7: ARG001 Unused function argument: `x`

The current Ruff settings (any relevant sections from your pyproject.toml).
The current Ruff version (ruff --version).

ruff --version
ruff 0.0.242

Thanks for the clear issue :)

Amazing work — much appreciated!


Make glue gun command

maybe implement using sound commands or regular commands similar to fastest easter egg

added this, hopefully its cool :)


Poetry can't run in directories without pyproject.toml after installing plugin

I started to use this plugin midway in my previous project and it worked very well.
But when I tried to create a new project, an error poped up.
Poetry could not find a pyproject.toml file in <CURRENT DIRECTORY> or its parents

Before installing the plugin, this only occorred when I typed somthing like poetry version where pyproject.toml was necessary.
In this case I simply typed the poetry command, just to see the help messages.
Stack trace (-vvv):
 Stack trace:
  8  ~/.local/pipx/venvs/poetry/lib/python3.12/site-packages/cleo/application.py:327 in run
      325│
      326│             try:
    → 327│                 exit_code = self._run(io)
      328│             except BrokenPipeError:
      329│                 # If we are piped to another process, it may close early and send a
  7  ~/.local/pipx/venvs/poetry/lib/python3.12/site-packages/poetry/console/application.py:188 in _run
      186│         self._disable_cache = io.input.has_parameter_option("--no-cache")
      187│
    → 188│         self._load_plugins(io)
      189│
      190│         exit_code: int = super()._run(io)
  6  ~/.local/pipx/venvs/poetry/lib/python3.12/site-packages/poetry/console/application.py:355 in _load_plugins
      353│             manager = PluginManager(ApplicationPlugin.group)
      354│             manager.load_plugins()
    → 355│             manager.activate(self)
      356│
      357│             # We have to override the command from poetry-plugin-export
  5  ~/.local/pipx/venvs/poetry/lib/python3.12/site-packages/poetry/plugins/plugin_manager.py:71 in activate
       69│     def activate(self, *args: Any, **kwargs: Any) -> None:
       70│         for plugin in self._plugins:
    →  71│             plugin.activate(*args, **kwargs)
       72│
       73│     def _load_plugin_entry_point(self, ep: metadata.EntryPoint) -> None:
  4  ~/.local/pipx/venvs/poetry/lib/python3.12/site-packages/poetry_auto_export/plugin.py:22 in activate
       20│         if not application.event_dispatcher:
       21│             return
    →  22│         self.configs = self._parse_pyproject(application.poetry.pyproject.data)
       23│         application.event_dispatcher.add_listener(TERMINATE, self.run_exports)
       24│         return super().activate(application)
  3  ~/.local/pipx/venvs/poetry/lib/python3.12/site-packages/poetry/console/application.py:129 in poetry
      127│             project_path = self._io.input.option("directory")
      128│
    → 129│         self._poetry = Factory().create_poetry(
      130│             cwd=project_path,
      131│             io=self._io,
  2  ~/.local/pipx/venvs/poetry/lib/python3.12/site-packages/poetry/factory.py:58 in create_poetry
       56│             io = NullIO()
       57│
    →  58│         base_poetry = super().create_poetry(cwd=cwd, with_groups=with_groups)
       59│
       60│         poetry_file = base_poetry.pyproject_path
  1  ~/.local/pipx/venvs/poetry/lib/python3.12/site-packages/poetry/core/factory.py:50 in create_poetry
       48│         from poetry.core.pyproject.toml import PyProjectTOML
       49│
    →  50│         poetry_file = self.locate(cwd)
       51│         local_config = PyProjectTOML(path=poetry_file).poetry_config
       52│
  RuntimeError
  Poetry could not find a pyproject.toml file in <CURRENT DIRECTORY> or its parents
  at ~/.local/pipx/venvs/poetry/lib/python3.12/site-packages/poetry/core/factory.py:507 in locate
      503│             if poetry_file.exists():
      504│                 return poetry_file
      505│
      506│         else:
    → 507│             raise RuntimeError(
      508│                 f"Poetry could not find a pyproject.toml file in {cwd} or its parents"
      509│             )
      510│

Possible solution
It seem like the problem is related to parsing the config in activate()
If the parsing of config is delayed (ex: parse the config in run_exports), the problem sould be solved :)

Thanks for reporting this - please try out v0.2.2 which I've just released.

Thank you, it works :)


Prepare for nupm

Fixes #1 by adding nupm.nuon (not fully specified yet) and moving the main script inside the module. Also fixes a recent syntax error. I verified all commands working after nupm install bru. I'll add that to the readme after I PR https://github.com/nushell/nupm/blob/main/registry.nuon.

@selfagency Active?

So sorry, for some reason I didn't get your notifications. I'll have to look into why.


Upgrade manypkg/get-packages

SUMMARY

Upgrade to latest major release of @manypkg/get-packages
This includes the reorganized @manypkg/tools collection

DETAILS

Adjust various call points and checks to reflect the updated interface of get-packages.
Code paths that check for specific tools can use tool.type instead of tool.
Code paths that must create a tool (mostly unit tests) now import @manypkg/tools so they can use prefab tool implementations. (It's not required -- you could define your own fake monorepo implementation inline for testing -- but this was the easiest way to confirm that the previous intent was still being met.)

For the most part, there should be no functional changes in this PR except those introduced in the latest version of get-packages:

Rush monorepos are now parsed correctly and work for changeset creation + changeset version commands.
Bolt monorepos are no longer supported.

Note that for Rush specifically, changeset publish needs more work, which will come in a separate dedicated PR.
TESTING

Updated existing unit tests
Verified behavior in local Rush monorepo

Could we also add a test that would check changeset add and changeset version in Rush monorepos?

@elliot-nelson just curious, is this effort still being pursued?

@akphi ye, definitely

Thanks for ping though looks like this is stalled on me 😅 I'll get those 2 additional tests added in next couple days.

@elliot-nelson did you have chance to look at this again?

I think this will also fix this bug: https://github.com/changesets/changesets/issues/1209
I was investigating this and created more tests for manypkgs, but there it worked fine. Only then I realized changesets was using an old version.
What is left here? I cannot see the circleCI pipeline, so not sure what's broken. Can I somehow help get this over the finish line?

Anything we can do to help get this released? I'm at a standstill with a pnpm monorepo. @elliot-nelson

@Andarist 👋 Hi Andarist, long time no chat :). I've added tests that shows basic rush add and rush version commands working in a Rush-style monorepo with no root package file, and all existing tests for non-Rush repos should work as well.

Hi @Andarist , I'm wondering if you could have a look at this old PR? The latest manypkg release cuts a bunch of dependencies.

<EMAIL_ADDRESS>- 46 dependencies
<EMAIL_ADDRESS>- 23 dependencies

I know it's been a while, but if there's still interest in the PR, we've created a next branch to combine all the breaking changes, and perhaps this PR can be part of it too. Happy to leave a review too if so.


Support Building multi-arch container imagers

Adding s390x and ppc64le to the platform for building operator images.
Fix pr image build issues.

Thank you, this will be very helpful.


Add support for typography weight

@nolastan I'm trying to add support for font weights as well. I updated the code and my Google Sheet, but it doesn't seem to be parsing it.
Any ideas on what's missing?

@nolastan I'm trying to add support for font weights as well. I updated the code and my Google Sheet, but it doesn't seem to be parsing it.
Any ideas on what's missing?

Ahh, it's not exposed? http://developer.sketchapp.com/reference/MSTextLayer/
Bummer.

Each weight is actually a different font file on your computer. See the template for an example on how to use with Arial.

@nolastan Nice! That worked. Thanks.

Added a section on this to the readme to help others.


[tts] figure out audio library strategy

Other than the issue I had getting the current audio library to work with cloud TTS, the current library can't play byte arrays on iOS. I didn't want to use multiple libraries so I tried to get the periodic silent sound to work with just_audio, the library I used for the demo. Unfortunately, I couldn't configure it to duck audio or play without pausing an external audio source such as Spotify, YouTube, etc. Both libraries work together without conflicting. Also, audio sources also aren't affected.

I think it's ok to use multiple libraries. We'll deal with the technical debt later. We have a similar issue with webviews rn :(

Although, perhaps one way around it would be to pass the entire URL to the audio library instead of having it play a byte array?


Swift 3 Support Added🍾

I have added Swift 3 Support for this repo with all the api design guideline's in mind. but the swift 2 option is still available in the repo so the user can choose what to use between Swift 2 and Swift 3..

Hey @NSAryan12, thank you very much for your contribution!
As to your solution, I'm not quite sure this is the way to go. We have a swift-3 branch which is being kept up to date (so it compiles, I'm not quite sure if all methods are already renamed, i.e. conform to the Swift 3 naming guidelines). Your solution duplicates code (pretty much everything :) ) which is an anti pattern.
I think the way to go is to merge the swift3 branch into master once Swift 3 is out of beta later this year. Swift 3 brings source stability (not really but for the developer it will look like it) so that there is only one major change coming in the near future (with the developer forced to change code due to an update).
That being said there is also another branch, the great protocol transformation or so where I started trying to solve the problem of TVs being only available on tvOS, phones pods and pads only on iOS which is bad for developers who support more than one platform because they have to #if os(iOS) etc. This made (and still makes) sense, but with swift being portable to all kinds of Linux machines this approach has to be rethought (it's also an open issue). However, I currently don't have the time to develop that further, but using the source breaking changes of Swift 3 to break not only the code of this framework but also its core APIs might be the best point in time. But I'm not sure if I can land the changes until September / October though (and if they approach makes more sense - this has yet to be explored), maybe a new framework makes more sense so that developers have a choice what they use, I don't know ... Time will tell :)
However, again THANK YOU very much for not only using but also contributing!! It means a lot to me :) feel free to apply the API changes to the swift3 branch if you want!


Compare searches

This code is a big mess but I've been staring at it for a while and wanted to get it over to you for at least a first review.  A clean UI would let users select two or more different searches and send them all through.  This doesn't - it only lets you pick two, from the bottom of the summary screen.  it orders the hashtags by the hashtag counts sorted on the first search (the one whose summary you were previous reviewing).  You can reverse the numbers in the URL pattern and add ids to the end to see more than two at once, e.g. compare?ids=3,4,5 and the chart should give reasonable colors, spacing, etc. to all of them.
This somehow got me into the depths of where the API begins and ends and what I should do with pandas vs. just javascript.  Obviously I got a little bogged down in it.  It'll be easier to make some clean decisions about all this when we make framework choices and just build from there.  I hope.

I think this is what we needed. It would be interesting to think through what would happen with the pandas merge when there were large numbers of hashtags, or similar. I'd still like for us to think about positioning Spark in this application.