Extract ak.Array type for repr

Might be helpful in the DataFrame/Series repr to see what the type of the array is. LMK if this would be desired.

I feel like this string might be very long in some cases. Is there a reasonable limit to how many characters we should return?

Ah fair point. Not off the top of my head, but I believe the pandas repr should truncate according to the default formatting options: https://pandas.pydata.org/pandas-docs/stable/user_guide/options.html
Maybe instead a new method could be provided e.g. ak.array_type to return the type separately?

@mroeschke , at some point, we discussed some workflows that you had come across that would be hard/slow to do in pure pandas but might suit this project. Any chance you can create an issue with as many details as you can gather?
Also, you'd be very welcome to discuss your thoughts on moving ahead with the awkward team, either at our Thursday morning sync-up or any other time that's convenient for you and @jpivarski .

Good to meet you, @mroeschke!
Types can be very verbose. Given this dataset,
>>> import awkward._v2 as ak
>>> array = ak.from_parquet("https://pivarski-princeton.s3.amazonaws.com/chicago-taxi.parquet", row_groups=[0])

The type __repr__ is long and ugly,
>>> array.type
ArrayType(ListType(RecordType([RecordType([OptionType(NumpyType('float32')), OptionType(NumpyType('float32')), RecordType([OptionType(NumpyType('float64')), OptionType(NumpyType('float64')), OptionType(NumpyType('datetime64[ms]'))], ['lon', 'lat', 'time']), RecordType([OptionType(NumpyType('float64')), OptionType(NumpyType('float64')), OptionType(NumpyType('datetime64[ms]'))], ['lon', 'lat', 'time']), ListType(RecordType([NumpyType('float32'), NumpyType('float32')], ['londiff', 'latdiff']))], ['sec', 'km', 'begin', 'end', 'path']), RecordType([OptionType(NumpyType('float32')), OptionType(NumpyType('float32')), OptionType(NumpyType('float32')), ListType(NumpyType('uint8', parameters={'__array__': 'char'}, typestr='char'), typestr='string')], ['fare', 'tips', 'total', 'type']), ListType(NumpyType('uint8', parameters={'__array__': 'char'}, typestr='char'), typestr='string')], ['trip', 'payment', 'company'])), 353)

but the type __str__ is a little better, in Datashape format.
>>> print(array.type)
353 * var * {trip: {sec: ?float32, km: ?float32, begin: {lon: ?float64, lat: ?float64, time: ?datetime64[ms]}, end: {lon: ?float64, lat: ?float64, time: ?datetime64[ms]}, path: var * {londiff: float32, latdiff: float32}}, payment: {fare: ?float32, tips: ?float32, total: ?float32, type: string}, company: string}

The output of show is ideal for a complicated case like this, in that it's multi-line:
>>> import io
>>> tmp = io.StringIO()
>>> array.type.show(stream=tmp)
>>> print(tmp.getvalue())
353 * var * {
    trip: {
        sec: ?float32,
        km: ?float32,
        begin: {
            lon: ?float64,
            lat: ?float64,
            time: ?datetime64[ms]
        },
        end: {
            lon: ?float64,
            lat: ?float64,
            time: ?datetime64[ms]
        },
        path: var * {
            londiff: float32,
            latdiff: float32
        }
    },
    payment: {
        fare: ?float32,
        tips: ?float32,
        total: ?float32,
        type: string
    },
    company: string
}

but that's not going to be useful in the __repr__ of a dtype, if that's what you're looking for. In that case, the best you can do is to truncate the __str__, as we do for the ak.Array.__repr__.
>>> array
<Array [[{trip: {...}, ...}, ..., {...}], ...] type='353 * var * {trip: {se...'>

But then, arrays that are going into Pandas would be exploded, since Pandas can already handle top-level columns. For this array, that would mean,
>>> exploded = dict(zip(ak.fields(array), ak.unzip(array)))
>>> exploded["trip"].type.show()
353 * var * {
    sec: ?float32,
    km: ?float32,
    begin: {
        lon: ?float64,
        lat: ?float64,
        time: ?datetime64[ms]
    },
    end: {
        lon: ?float64,
        lat: ?float64,
        time: ?datetime64[ms]
    },
    path: var * {
        londiff: float32,
        latdiff: float32
    }
}
>>> exploded["payment"].type.show()
353 * var * {
    fare: ?float32,
    tips: ?float32,
    total: ?float32,
    type: string
}
>>> exploded["company"].type.show()
353 * var * string

Maybe two levels of exploding for this array:
>>> exploded2 = dict(zip(ak.fields(exploded["trip"]), ak.unzip(exploded["trip"])))
>>> exploded2["sec"].type.show()
353 * var * ?float32
>>> exploded2["km"].type.show()
353 * var * ?float32
>>> exploded2["begin"].type.show()
353 * var * {
    lon: ?float64,
    lat: ?float64,
    time: ?datetime64[ms]
}
>>> exploded2["end"].type.show()
353 * var * {
    lon: ?float64,
    lat: ?float64,
    time: ?datetime64[ms]
}
>>> exploded2["path"].type.show()
353 * var * var * {
    londiff: float32,
    latdiff: float32
}

Pandas users probably wouldn't be interested in the length of each array, since they'd all be identical in a DataFrame (the 353 above). Also, the DataFrame displays that value elsewhere, not in the dtype. In an Awkward Type, it's encoded as an outer layer (Python class is ArrayType), which can be stripped off:
>>> print(exploded2["sec"].type.content)
var * ?float32
>>> print(exploded2["km"].type.content)
var * ?float32
>>> print(exploded2["begin"].type.content)
var * {lon: ?float64, lat: ?float64, time: ?datetime64[ms]}
>>> print(exploded2["end"].type.content)
var * {lon: ?float64, lat: ?float64, time: ?datetime64[ms]}
>>> print(exploded2["path"].type.content)
var * var * {londiff: float32, latdiff: float32}

These strings are perhaps the most useful, even if you have to truncate them to a maximum number of characters.
As Arrow, rather than Awkward, I don't see an option for a user (data analyst)-friendly string:
>>> ak.to_arrow(exploded2["path"], extensionarray=False).type
ListType(list<item: large_list<item: struct<londiff: float not null, latdiff: float not null> not null> not null>)

>>> print(ak.to_arrow(exploded2["path"], extensionarray=False).type)
list<item: large_list<item: struct<londiff: float not null, latdiff: float not null> not null> not null>

At least, not as a member function. Maybe there's something that I don't know about.

Yeah given the verbosity of potential types in awkward, this enhancement is probably not worth moving forward.
@martindurant I'll open up an issue with operations that are not easy to do in pandas but might be suitable for awkward. In terms of moving forward, I don't have too much time to help develop the actual awkward ExtensionArray or ExtensionDtype, but I am eager to chime in if there are pandas semantics questions or and bugs uncovered when developing the array or dtype


No Smokey

Please add a photo of Smokey when skimming is detected to the demo.

@ericwbailey I can't decide which photo to use...


Your project will be removed on Dec 24, 2014, if still unpublished.

This was a problem while using CodePlex.

Closed Dec 11, 2014 at 5:54 PM by Nonki
Push from Git Gui has been succeeded.


Allow delegate use in Trait Implementations

I have some code (here) where I would like to re-use code from an external crate, but specifically re-use the trait implementation. I'm not sure if delegate! currently supports this, as it works fine when in the usual impl Struct body, but errors when in impl Trait for Struct body, citing the error E0599 or
no method named x found for typeStruct in current scope
note: the method x exists but the following trait bounds were not satisfied: Struct: Trait
This makes me think that the trait is not in scope of the macro.
For reference the code I am talking about is here:
https://github.com/ethdbg/edb/blob/e5a50342ebcf36b261f98a7e9874a706c0ec3178/emul/src/debug_externalities.rs#L152
(commented out is the code that works)

I have solved the issue, it had nothing to do with the macro, it was instead related to using
impl vm::Ext for Struct instead of impl Ext for Struct directly. After changing that part of the code, the issue was solved.
I apologize for opening an unrelated issue!


refactor(swap): use params struct

Refactor to use a params struct making it similar to the updated SwapToAnyToken example: https://github.com/zeta-chain/example-contracts/pull/181

@andresaiello please, review.


[PowerPoint] Clarifying Slide add/delete availability

Fixes #2723 by adding the steps to enable preview APIs in an API to the add slides topic.

Docs Build status updates of commit c0c8cb0:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs/powerpoint/add-slides.md
:white_check_mark:Succeeded
View

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


Replace size_t sort by unsigned int one

This needs a lot more investigation, so a draft for now.
For TIOGA, this is always not worse, and sometimes a lot better.

So the point is that radix-sort depends on the number type?

@masterleinad I don't think this is a radix sort.

This may not be the best way to go. See #145.


Implement Dynamic Voice Response with Interruption Handling for LLM Outputs

We propose implementing a feature that allows the LLM model to stream its response in smaller chunks (or using a similar strategy), enabling voice playback to begin as soon as the user starts speaking. If the user interrupts the response, playback will pause, and the response flow will be dynamically adjusted.
This enhancement aims to optimize both cost and processing time by avoiding the need to process or pay for the entire response when an interruption occurs.
Key Objectives:

Implement response streaming or chunking for LLM outputs.
Detect user interruptions and pause the playback accordingly.
Dynamically adjust the response flow based on user interactions.
Optimize resource usage by processing only necessary portions of the response.

This feature would improve user experience and efficiency, especially in scenarios where immediate and responsive interactions are crucial.

Additionally, we aim to transform our AI assistant into an active participant in meetings. During meetings, the assistant should be able to respond to queries (using tools that retrieve information from systems, the web, and BI), recall past points discussed, and provide timely comments throughout the meeting. The assistant will wait for a command with its name to begin interacting and should assist in maintaining a summarized action plan and topics already discussed. The system should function effectively in voice-based meeting rooms.


Error: "HashType and Secret have incompatible length or not hexadecimal string"

Expected behavior and actual behavior.
accountHttp.transactions not throwing? when fetching the following transaction:

99174671B5B28D4A729AC7AAB3A2A4F13B72206EE916CD3AC07C794B572A1210

Steps to reproduce the problem.
get this transaction through a  accountHttp.transactions call

current link:
http://<IP_ADDRESS>:3000/account/AC1A6E1D8DE5B17D2C6B1293F1CAD3829EEACF38D09311BB3C8E5A880092DE26/transactions?pageSize=10

Specifications like the version of the project, operating system, or hardware.
"nem2-sdk": {
"version": "0.11.5",

@decentraliser It's fixed already
check this out
https://github.com/nemtech/nem2-sdk-typescript-javascript/issues/138
and
https://github.com/nemtech/nem2-library-js/pull/39


WSL Bash hangs on launch

System Info
Windows build number:  Microsoft Windows [Version 10.0.17713.1000]
Distribution: Ubuntu 16.04.4 LTS
Kernel: 4.4.0-17713-Microsoft

What I'm doing
Running bash.exe

What's happening
When I run bash.exe the program opens, but hangs indefinitely.
I need to start up 5/6 instances to get one that's working as expected.

Here are the .etl log files. (had to change the extension to .txt in order to load it here)
lxcore_adss.txt
lxcore_kernel.txt
lxcore_service.txt

Thanks for sending the traces.  It looks like either zsh is running into some kind of issue.  Would it be possible to try switching to bash to see if things still hang?

Still hanging after switching to bash

I had the same issue and narrowed it down to initializing nvm in my .zshrc.  In fact, I was unable to get nvm to function manually even from bash. In my case simply not using nvm and installing node globally made everything work fine.

I'm experiencing the same issue as described by @glenstarchman, initialising nvm in my .zshrc file will cause really slow startup of zsh (and bash I think, but I don't use bash as my default shell 😝).

Might be related to https://github.com/creationix/nvm/issues/1868

Highly likely that @arcanis is correct.  I am experiencing the same issue.

If you find an zombie after a hang, this is probably related to #3741


Feature Request: Add Kubernetes Node Costs with Reserved Instances

Hi,
We’ve identified an issue with displaying costs for Kubernetes nodes covered by Reserved Instances in Azure. Currently, customers cannot view these costs in Vantage because the API being used, the CostDetailsReport API, pulls data from individual subscriptions and cannot integrate with the billing account scope due to CSP model limitations.
This issue appears to come from the indirect CSP model, where billing account data resides at the distributor's level (e.g., Tech Data) and is inaccessible at the customer level. Consequently, customers are unable to view or allocate Kubernetes Reserved Instance costs effectively.
Additional information:

Commitments are made on the VMs hosting Kubernetes clusters, but Reserved Instance costs cannot be viewed or allocated between clusters or nodes.

The amortized cost view does not reflect these costs, resulting in a significant gap in cost visibility.

Since integration at the billing account scope is not possible due to the CSP model, is there any workaround or alternative solution to resolve this limitation?

Hi Bruno, this is not related to the Terraform provider, but we have logged this on our side. Going to close this out.


modifications for two kube-apiserver dashboards - basic and advanced

What does this PR do?

🛑 Please open an issue first to discuss any significant work and flesh out details/direction - we would hate for your time to be wasted. Consult the CONTRIBUTING guide for submitting pull-requests.
Motivation

More

[ ] Yes, I have tested the PR using my local account setup  (Provide any test evidence report under Additional Notes)
[ ] Yes, I ran pre-commit run -a with this PR
[ ] Yes, I have added a new example under examples to support my PR (when applicable)
[ ] Yes, I have updated the Pages for this feature

Note: Not all the PRs required examples and docs.
For Moderators

[ ] E2E Test successfully complete before merge?

Additional Notes

Will create a more extensive PR in a minute to include API server troubleshooting dashboard as well


[FEA] non-UTC time zone feature needs a new kernel to parse time string in a local time zone.

Is your feature request related to a problem? Please describe.
For casting string in a specific time zone to timestamp, Spark first parse string to segments(year, mohth, day, hour, minute, seconds ...), then create a local time from the segments, then convert the local time in the specific time zone to UTC time. Refer to: spark code .
Currently, TimeZoneDB APIs are:

fromTimestampToUtcTimestamp(timestamp_column(long cv), zoneId)
fromUtcTimestampToTimestamp(timestamp_column(long cv), zoneId)

They are not enough, we should implment a new API like:

parseLocalTimestampString(string_column, zoneId)

Describe the solution you'd like
In parseLocalTimestampString kernel
First parse string to segments, refer to this JNI PR, then transform segments in the specific time zone to UTC time. The transform needs to query the time zone transition/transition rule tables. Kernel should provide:

def transform_from_local_time_segments_to_utc(zongId, int year, int month, ... int nanoSeconds) : Long

So the overall logic will be:

parse string to segments(year, month, day ...)
transfrom segments to UTC timestamp long value

Note:
-Parser should  provide a option to to handle special string: EPOCH, NOW, ...... for Spark before 320.

For Ansi mode, should investigate how to handle this mode efficiently.

Similar to this issue: https://github.com/NVIDIA/spark-rapids/issues/6846

Close this because it's tracked by https://github.com/NVIDIA/spark-rapids/issues/6846


v0.0.x Documentation

The Juice
Before any development goes on, we definitely need to document what our version 0.0.x tool is. Because this will all bundle to a package release, and because the code will in theory have to pass a basic test to begin with that is informed by use case rather than code structure, we should have a document guiding what the version 0.0.x needs to do.
I suspect the forthcoming problem is that we need to describe the product case from top to bottom. Not the worst idea though.

Should be a wiki page, by the by

Here you go https://github.com/jackdixonryan/venture/wiki/0.0.x:-The-Coder's-Morning


Improve documentation: migration to v12 missing examples and migration to v13 additional info for tabs

Question
Hey guys, one suggestion, i think it would make sense to update migration guide on v13 that now we have new component bal-stack and that tabs and steps need to be put inside it in order not to have this ugly arrows for left and right even though it fits on the screen :disappointed:. For example if you go here arrows are already there:
https://design.baloise.dev/?path=/story/components-navigation-steps--basic. Should i open an issue and what do you think about it ?
Also seems like examples are again missing in migration to v12: https://design.baloise.dev/?path=/docs/development-upgrade-guides-updating-to-v12--page (edited)
Additional Information
Go to canvas of  components-navigation-steps--basic, use size of preview to large desktop and it should be something like this:

This does not seem right or we need to use bal-stack? There is no need for right arrow?
Code of Conduct

[X] I agree to follow this project's Code of Conduct

done with #885 and #887
will be released soon


Add some python client examples to the docs

Some self-contained / end-to-end examples of:

Using the python SDK to manipulate ServingRuntimes / InferenceServices
Generating gRPC stubs for the KServe V2 API and using these to make inference requests, including some that demonstrate using string/bytes datatype
Making inferencing requests using the KServe V2 REST API

A couple of relevant resources re: Python SDK

https://kserve.github.io/website/0.10/sdk_docs/sdk_doc/
https://github.com/kserve/modelmesh-serving/issues/293

A good first issue for me to contribute in the community. So I will work on this now. Thanks

Thanks @lamoghaighoroje!


(refactor) Transition from revocation registry deltas to revocation status lists

since the move to anoncreds-rs, some of the codebase uses the newer anoncreds status-list types, and other parts still use the old deltas.
As of #1308 , all holder/prover functionality is using status list types for revocation (i.e. for creating revocation states in the proof), however verifier & issuer logic is still using revocation deltas.
This should be refactored such that only status lists are used/exposed (in indy-ledgers, deltas are still used on-ledger, but we shouldn't expose that). This would involve removing the get_rev_reg_delta ledger trait methods, and refactoring the anoncreds trait methods to use status lists.

I was not actually aware of the newer anoncreds status-list types--was that added as part of the AnonCreds 1.0 spec definition effort or as part of the 2.0 effort? Or somewhere else? I'd be interested in reading/learning more, so any pointers would be appreciated!

@JamesKEbert its in the 1.0 spec https://hyperledger.github.io/anoncreds-spec/#issuer-create-and-publish-revocation-registry-objects . I dont have a better pointer other than the spec 😅.
it's baked into anoncreds-rs, which ditched rev reg deltas etc. so internally our Anoncreds trait impl has been having to convert from deltas to status list before passing it to Anoncreds-rs - since our Anoncreds traits methods still use "deltas" as inputs and outputs.
I'd prefer if it was the job of our AnoncredsLedger (read/write) to do this conversion so that deltas don't make it deeper into our codebase. I believe this is the approach credo has done

For a bit of background — this change, plus the seqno of the Schema embedded in the CredDefId — were the only two changes needed to “de-Indy” the AnonCreds specification.
Indy’s use of deltas in RevRegEntries requires an “active” Verifiable Data Registry (VDR) component that can calculate the delta based on the input parameters of the request.  That’s very difficult for general purpose VDRs like Cheqd or a did:web server.  Much better to allow the issuer to be able to publish the full state of the registry on each update, and the client be required to retrieve a “point in time” state of the RevReg (vs. deltas over an arbitrary period).  While the size of the state might be a problem for a massive RevRegs, since AnonCreds is limited to RevRegs of max 2k or 3k credentials, a bit array with full state is quite small.

Thank you for the context--it's a really nice to see change, as I know I've experienced some messy headaches related to the deltas in the past, so something simpler is nice.


Minimap show area incorrect

Minimap show area in Linux Ubuntu is incorrect!

Closing as extension problem. @bertolottipf please file an issue with WD Minimap https://github.com/websiteduck/brackets-wdminimap repo.  Since he is no longer maintaining the extension you may try forking the repo and fixing it.


Create a Validation CR

The CR should run validation for a specific pull request.
Tentative structure:
apiVersion: mpas.ocm.software/v1alpha1
kind: Validation
metadata:
  name: podinfo
  namespace: mpas-sample-project
spec:
  pullRequest: 1 # id of the pull request
  repositroyRef:
    name: podinfo-repo
    namespace: mpas-system
  validationRules:
    sourceRef: ?? # probably the snapshot where the validation rules can be fetched from?
  interval: 5s
  gitRepositroyRef:
    name: values-yaml-git-repo
  serviceAccountName: mpas-sample-project

This should watch the git repository source and run validation on the values yaml file.

We need to create a new repository  because Flux GitRepositories are per branch.

Right, that will happen during the pull request creation. This assumes that that already exists. I'll create the issue for that now.

Oh, I already created that: https://github.com/open-component-model/mpas-product-controller/issues/15 :D

Done


Mention that dbt docs generate needs to be run before dbt docs serve

Description & motivation

this one really puzzled me
docs serve wasn't working and googling the error msg didn't help
wording of the sentence that I want to add is up for discussion
alternative to adding this line to the docs: change DBT to implicitly running generate when user executes serve...

To-do before merge

Pre-release docs
Is this change related to an unreleased version of dbt?

[ ] Yes: please

update the base branch to next
add Changelog components: <Changelog>[New/Changed] in v0.x.0</Changelog>
add links to the "New and changed documentation" section of the latest Migration Guide

[x] No: please ensure the base branch is current
[ ] Unsure: we'll let you know!

@annafil @runleonarun It's been >6 weeks. That feels pretty disappointing.

👋🏻 @pofl I'm Leona, the new person dedicated to the docs site. I'm planning making sure we have people dedicated to reviewing PRs and issues that come in, but we're not quite there yet. Thank you for the ping and I will get this reviewed.
While I have your ear, I'm curious what you think is an acceptable turnaround time for reviewing a submitted docs PR? Your opinion is very much appreciated!

👋🏻 @pofl I'm Leona, the new person dedicated to the docs site. I'm planning on making sure we have people dedicated to reviewing PRs and issues that come in, but we're not quite there yet. Thank you for the ping and your patience, and I will get this reviewed.
While I have your ear, I'm curious what you think is an acceptable turnaround time for reviewing a submitted docs PR? Your opinion is very much appreciated!

That's a good question and I love the openness and spontaneity to just ask me :D
At work, when a review is requested from me, I usually do it the same or the next day. My own personal goal is to comply within 48 hours. When I request a review from my colleagues I expect the same response time. Frankly speaking, if nothing happens within two days, I'm starting to feel a little unhappy about the situation but not angry. If I get a note along the lines of "sorry, I'm a little overloaded atm, it's gonna take a little longer" then I'm completely fine. If I get no reaction in three days, 90% of the time nothing is ever going to happen if I don't ping the person again.
However, work is different from contributing here. At work there is this dimension of unblocking colleagues / helping them getting stuff over the finish line. If you don't approve of my contribution here, there is absolutely no issue caused on my end.
All that said, when I submitted my PR here, frankly speaking, my expectation was something like "alright, there is somebody at DBT Labs getting paid for this" and I felt like within a week tops, somebody should have gotten to have a look at this. So I guess this is my answer. Optimally 48 hours, with 1 week still being acceptable.
Something that's always is some kind of bot/automation. One thing it could do is manage expectations "hey thanks for contributing, we usually respond within x days" or "we have so many PRs at the moment, we're sorry but it could take some time". Another thing it could do is ping reviewers automatically after x days.

Something that's always is some kind of bot/automation. One thing it could do is manage expectations "hey thanks for contributing, we usually respond within x days" or "we have so many PRs at the moment, we're sorry but it could take some time". Another thing it could do is ping reviewers automatically after x days.

I like the idea of a response time bot that responds when you open a PR! I have slowly been adding more GitHub workflows to help with managing the docs workflow.
I recently added a labeler workflow that puts a size label on the PR so my colleagues who focus on other things can feel free to find smaller contributions and review/approve them. The idea being that some larger contributions will take some focus time to test and review.
I am going to work with a colleague and open up a discussion about this workflow to get ideas about how other OSS projects respond to PRs. Stay tuned for that!
OK now I will get your helpful contribution merged 😅


ghcjsHEAD: upgrade ghcjs-boot packages

@TravisWhitaker @peti at LumiGuide we have some trouble with incompatible aeson versions between GHC and GHCJS. In https://github.com/ghcjs/ghcjs-boot/pull/41 I move the ghcjs-boot packages closer to the latest LTS.
I tested it by building and running a big GHCJS app.
What do you think about this? Is it OK to merge or do you want to wait until the upstream PR is merged? (In defence of merging: I emailed Luite a week ago about upgrading aeson but he didn't respond. Probably because he's traveling through China according to Facebook.)
If you want to merge it it would be great if this can also be cherry-picked on release-17.03.

Please hold with merging this. I discovered an issue while running our app.

The issue has been resolved and it now works correctly.


lazy lookup: timeout: timed out

Hi! I've just got this with version 1.2.450.
2016-02-09 21:05 CRITICAL manager       nC_movie-HUN    An unexpected crash has occurred. Writing crash report to /home/osmc/.flexget/crash_rep
ort.2<IP_ADDRESS>527668896.log. Please verify you are running the latest version of flexget by using "flexget -V" from CLI or by using version
_checker plugin at http://flexget.com/wiki/Plugins/version_checker. You are currently using version 1.2.450
2016-02-09 21:05 WARNING  movie_queue   nC_movie-HUN    IMDB and TMDB lookups failed for The.Intern.2015.BD25.AVC.DTSHD.HUN-HDPhoenix.
2016-02-09 21:05 ERROR    lazy_lookup   nC_movie-HUN    Unhandled error in lazy lookup plugin
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/flexget/utils/lazy_dict.py", line 36, in __getitem__
    func(self.store)
  File "/usr/local/lib/python2.7/dist-packages/flexget/plugins/metainfo/tmdb_lookup.py", line 62, in lazy_loader
    session=session)
  File "/usr/local/lib/python2.7/dist-packages/flexget/utils/database.py", line 27, in wrapper
    return func(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/flexget/plugins/api_tmdb.py", line 309, in lookup
    result = _first_result(tmdb3.tmdb_api.searchMovie(title.lower(), adult=True))
  File "/usr/local/lib/python2.7/dist-packages/tmdb3/tmdb_api.py", line 133, in searchMovie
    return MovieSearchResult(Request('search/movie', **kwargs), locale=locale)
  File "/usr/local/lib/python2.7/dist-packages/tmdb3/tmdb_api.py", line 162, in __init__
    lambda x: Movie(raw=x, locale=locale))
  File "/usr/local/lib/python2.7/dist-packages/tmdb3/pager.py", line 109, in __init__
    super(PagedRequest, self).__init__(self._getpage(1), 20)
  File "/usr/local/lib/python2.7/dist-packages/tmdb3/pager.py", line 62, in __init__
    self._data = list(iterable)
  File "/usr/local/lib/python2.7/dist-packages/tmdb3/pager.py", line 113, in _getpage
    res = req.readJSON()
  File "/usr/local/lib/python2.7/dist-packages/tmdb3/cache.py", line 131, in __call__
    data = self.func(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/tmdb3/request.py", line 118, in readJSON
    data = json.load(self.open())
  File "/usr/local/lib/python2.7/dist-packages/tmdb3/request.py", line 104, in open
    return urllib2.urlopen(self)
  File "/usr/lib/python2.7/urllib2.py", line 154, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/lib/python2.7/urllib2.py", line 431, in open
    response = self._open(req, data)
  File "/usr/lib/python2.7/urllib2.py", line 449, in _open
    '_open', req)
  File "/usr/lib/python2.7/urllib2.py", line 409, in _call_chain
    result = func(*args)
  File "/usr/lib/python2.7/urllib2.py", line 1227, in http_open
    return self.do_open(httplib.HTTPConnection, req)
  File "/usr/lib/python2.7/urllib2.py", line 1200, in do_open
    r = h.getresponse(buffering=True)
  File "/usr/lib/python2.7/httplib.py", line 1073, in getresponse
    response.begin()
  File "/usr/lib/python2.7/httplib.py", line 415, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python2.7/httplib.py", line 371, in _read_status
    line = self.fp.readline(_MAXLINE + 1)
  File "/usr/lib/python2.7/socket.py", line 476, in readline
    data = self._sock.recv(self._rbufsize)
timeout: timed out

Related #671

Looks like the tmdb3 library we are using tries to partially abstract away network errors, but doesn't do it completely. Perhaps it's worth switching to a different library. This one https://github.com/celiao/tmdbsimple is built on requests and doesn't try to abstract away the network errors at all, might be nicer to use that and just trow the api calls in a RequestException try block.


Update

Stuck in new update dialogue
Although I hade update

update

Stuck in new update dialogue Although I hade update  update

use command in readme

Still same issu


Revisit eos_cli_config_gen BGP data model

Enhancement summary
Refactor of router_bgp data model to be consistent for global and discrete VRF, as raised by @c-po
router_bgp:
  as: "100"
  address_family_ipv4:
    networks:
      <IP_ADDRESS>/8:
    neighbors:
      <IP_ADDRESS>:
        prefix_list_in: "wan-in"

  vrfs:
    FooMPLS:
      address_families:
        ipv4:
          networks:
            <IP_ADDRESS>/29:
          neighbors:
            <IP_ADDRESS>:
              activate: true

Which component of AVD is impacted
eos_cli_config_gen
Use case example
Refactor router_bgp data model - TBD.
Describe the solution you would like
Refactor data model - TBD.
Describe alternatives you have considered
No response
Additional context
No response
Contributing Guide

[X] I agree to follow this project's Code of Conduct

I am in favor of defining vars for each address-family under the VRF context. So it follows the same style as for the default VRF. Although it requires more work in the schemas and templates, it will allow for a more well defined data model reflecting the differences between address-families.
@carlbuchmann


Figure out argument list implementation

An array of pointers should work fine, but maybe consider a linked list? Although an array of pointers should be faster to deal with. Additionally, review the documentation of VC4 more rigorously to ensure that no potential argument types were missed when creating the ARGUMENT_TYPES enumeration, to be safe. It shouldn't be difficult to change right now.

Also, maybe review some other architectures later to see if any other types of arguments not used by VC4 would need their own argument type to be represented.


Make IndexSet parametrized by Index type

Now that Index is a parametric type (depending on having QN storage or just the dimension for a non-QN Index), I think it would be useful to make IndexSet a parametric type. This is mostly for better code organization, to allow for type dispatch since many functions that accept IndexSet have different functionality and implementations depending on whether or not they have QNs.
Also, we may want to think about the storage type of IndexSet. I still can't decide if it should be a tuple or a mutable structure. Right now it is a SizedVector, which is similar to but implemented quite differently from an MVector (it is a wrapper type around a Vector with the size as a type parameter). It can't be an MVector because setindex! doesn't work for an MVector that stores dynamically sized objects, like our QN storage. For example:
julia> using StaticArrays

julia> v = MVector(([1,2],[3,4]))
2-element MArray{Tuple{2},Array{Int64,1},1,2} with indices SOneTo(2):
 [1, 2]
 [3, 4]

julia> v[1]
2-element Array{Int64,1}:
 1
 2

julia> v[1] = [4,5]
ERROR: setindex!() with non-isbitstype eltype is not supported by StaticArrays. Consider using SizedArray.
Stacktrace:
 [1] error(::String) at ./error.jl:33
 [2] setindex!(::MArray{Tuple{2},Array{Int64,1},1,2}, ::Array{Int64,1}, ::Int64) at /mnt/home/mfishman/.julia/packages/StaticArrays/1g9bq/src/MArray.jl:109
 [3] top-level scope at REPL[18]:1

Making it a Tuple storage may be annoying, since I believe it is quite common, at least internally, to replace indices in an IndexSet by setting values.

Agreed - I’ve already found some important use cases for this

This is closed by #216.


RMSnorm Implementation

Hi lucidrains,
I was looking at adding the ScaleNorm and RMSNorm to another repo, and the implementations look almost identical. I have linked to the official implementation below. Am I missing something about the implementation? Thanks for all the great work.
https://github.com/bzhangGo/rmsnorm

@gdevos010 Hi Greg
It is a bit subtle, but the only difference is that scale norm has one shared gamma multiplier across the entire feature dimension, while rms norm has gamma in the same dimension as the model dimensions https://github.com/lucidrains/x-transformers/blob/main/x_transformers/x_transformers.py#L352 vs https://github.com/lucidrains/x-transformers/blob/main/x_transformers/x_transformers.py#L363

@gdevos010 i would recommend rms norm, as it has been proven in a number of large language models out of deepmind

Thanks, that makes sense. However looking at the scale norm paper, I'm wondering whether this scaling is needed; it seems that it's 1 in the paper (referring to Eq. (5) here), but I might be missing something of course.

@hrzn ohh actually yes that appears to be an error on my part! thank you for catching that!

@hrzn @gdevos010 here is a paper that does some head to head runs of the different types of normalizations https://arxiv.org/abs/2102.11972 maybe informative for you

@hrzn @gdevos010 here is a paper that does some head to head runs of the different types of normalizations https://arxiv.org/abs/2102.11972 may be informative for you two

Oh nice, thanks. That's a very welcome paper!


Add support for zilliz as vector database

🚀 The feature

add new vector db https://zilliz.com/

Motivation, pitch
This gives more flexibility to the user to use any vector database of their own choice.

Hey @taranjeet , I would like to work on this, can I get started?


recount number of candidate

Counting number of candidate without resigned candidates: https://github.com/tomochain/tomomaster/issues/429

Travis failed because<EMAIL_ADDRESS>could not pass npm audit
There is no way to abort dev-dependencies when auditing: https://github.com/webpack/webpack-dev-server/issues/1566


London

Describe the bug

Steps To Reproduceå
Steps to reproduce the behavior:

Go to '...'
Click on '....'
Scroll down to '....'

Error description
Expected behavior

Screenshots

Desktop:

OS :
Browser :
Browser Version :

Smartphone:

Device :
OS <1-- e.g. iOS8.1 -->:
Browser :
Browser Version :

Additional Context

### Tasks
- [ ] https://github.com/near/wallet-selector/pull/1101
- [ ] https://github.com/near/wallet-selector/pull/1102
- [ ] https://github.com/near/wallet-selector/pull/1099

@Danyal4667  - what is this for?


Prepared Statements Incorrectly Storing Partition Information

CrateDB version
5.6.4
CrateDB setup information
any (single, multi, cloud)
Problem description
Queries instantly execute within a longer standing connection using psycopg3
Steps to Reproduce

CREATE TABLE scheduler_issue.base (
    ts TIMESTAMP,
    ts_g generated always as date_trunc('minute',ts)
) PARTITIONED BY (ts_g);

CREATE TABLE scheduler_issue.target (
    ts TIMESTAMP
);

import asyncio
from datetime import datetime
import psycopg

stmt1 = """
            INSERT INTO
            scheduler_issue.base (ts)
            SELECT
            ts
            FROM
            generate_series(
                date_trunc('minute', now()),
                date_trunc('minute', now() + '1 minute'::INTERVAL),
                5
            ) g (ts);"""

stmt2 = """INSERT INTO scheduler_issue.target (ts)
            SELECT a.ts FROM  scheduler_issue.base a
            LEFT JOIN scheduler_issue.base b USING (ts)
            LIMIT  100;"""

stmt3 = """ DELETE FROM scheduler_issue.base
            WHERE ts_g < now() - '3 minute'::INTERVAL;"""

async def run():
    # Replace these with your database connection details
    user = 'crate'
    password = ''
    database = 'crate'
    host = 'localhost'

    conn = await psycopg.AsyncConnection.connect(
        dbname=database, user=user, password=password, host=host)
    print("Connected to the database.")

    # Establishing a connection to the database
    try:
        async with conn:  # Using the connection as an async context manager
            async with conn.cursor() as cur:
                while True:
                    print(f"Executing at {datetime.now()}")
                    # First SQL statement

                    await cur.execute(stmt1)
                    result = cur.rowcount
                    print(f"Time: {datetime.now()}, Affected Rows: {result}")

                    # Second SQL statement
                    await cur.execute(stmt2)
                    result = cur.rowcount
                    print(f"Time: {datetime.now()}, Affected Rows: {result}")

                    # Third SQL statement
                    await cur.execute(stmt3)
                    result = cur.rowcount
                    print(f"Time: {datetime.now()}, Affected Rows: {result}")

                    # Wait for one minute before the next iteration
                    await asyncio.sleep(60)
    except Exception as e:
        print("An error occurred:", e)
    finally:
        # Ensure the connection is closed properly
        if not conn.closed:
            await conn.close()
        print("Connection closed.")

# Running the asynchronous function
asyncio.run(run())

output:
Executing at 2024-04-22 15:10:20.172728
Time: 2024-04-22 15:10:20.784048, Affected Rows: 12001
Time: 2024-04-22 15:10:20.807172, Affected Rows: 0 <-- table is not refreshed
Time: 2024-04-22 15:10:20.824693, Affected Rows: 0
Executing at 2024-04-22 15:11:20.827274
Time: 2024-04-22 15:11:21.154763, Affected Rows: 12001
Time: 2024-04-22 15:11:24.159505, Affected Rows: 100 <-- table is refreshed, insert successful
Time: 2024-04-22 15:11:24.164031, Affected Rows: 0
Executing at 2024-04-22 15:12:24.165954
Time: 2024-04-22 15:12:24.377397, Affected Rows: 12001
Time: 2024-04-22 15:12:30.074639, Affected Rows: 100
Time: 2024-04-22 15:12:30.078405, Affected Rows: 0
Executing at 2024-04-22 15:13:30.080687
Time: 2024-04-22 15:13:30.279791, Affected Rows: 12001
Time: 2024-04-22 15:13:38.045847, Affected Rows: 100
Time: 2024-04-22 15:13:38.071137, Affected Rows: -1
Executing at 2024-04-22 15:14:38.072112
Time: 2024-04-22 15:14:38.225661, Affected Rows: 12001
Time: 2024-04-22 15:14:45.784156, Affected Rows: 100
Time: 2024-04-22 15:14:45.805235, Affected Rows: -1
Executing at 2024-04-22 15:15:45.806786
Time: 2024-04-22 15:15:46.161335, Affected Rows: 12001
Time: 2024-04-22 15:15:53.979985, Affected Rows: 100
Time: 2024-04-22 15:15:54.003209, Affected Rows: -1
Executing at 2024-04-22 15:16:54.004968
Time: 2024-04-22 15:16:54.183757, Affected Rows: 12001
Time: 2024-04-22 15:16:54.199846, Affected Rows: 0 <-- fails within ms
Time: 2024-04-22 15:16:54.201445, Affected Rows: -1
Executing at 2024-04-22 15:17:54.203813
Time: 2024-04-22 15:17:54.444582, Affected Rows: 12001
Time: 2024-04-22 15:17:54.448275, Affected Rows: 0 <-- fails within ms
Time: 2024-04-22 15:17:54.449818, Affected Rows: -1
Executing at 2024-04-22 15:18:54.451699
Time: 2024-04-22 15:18:54.583264, Affected Rows: 12001
Time: 2024-04-22 15:18:54.587881, Affected Rows: 0 <-- fails within ms
Time: 2024-04-22 15:18:54.589297, Affected Rows: -1

Actual Result
Query executes successfully instantly, 0 records inserted
Expected Result
Query executes succesfully after a few seconds, 100 records inserted

What is suspicious:

the first 6 executions work fine
the 7th and following are partially failling

Looking at a wireshark recording there seems to be a behaviour change how asyncpg (3) is communicating with CrateDB all of a sudden (from second 349 - all logs before look the same):

I now switched it to have auto commit enabled with
conn = await psycopg.AsyncConnection.connect(
        dbname=database, user=user, password=password, host=host, autocommit=True)

Which works ... for the first 5 minutes ... then again ...

Forcing prepared statement with execute(stmt1, prepare=True) makes it fail quicker:
                    await cur.execute(stmt1, prepare=True)
                    result = cur.rowcount
                    print(f"Time: {datetime.now()}, Affected Rows: {result}")

                    # Second SQL statement
                    await cur.execute(stmt2 , prepare=True)
                    result = cur.rowcount
                    print(f"Time: {datetime.now()}, Affected Rows: {result}")

                    # Third SQL statement
                    await cur.execute(stmt3, prepare=True)
                    result = cur.rowcount
                    print(f"Time: {datetime.now()}, Affected Rows: {result}")

Executing at 2024-04-22 21:04:22.818460
Time: 2024-04-22 21:04:22.905894, Affected Rows: 12001
Time: 2024-04-22 21:04:30.486069, Affected Rows: 100
Time: 2024-04-22 21:04:30.500197, Affected Rows: -1
Executing at 2024-04-22 21:05:30.502028
Time: 2024-04-22 21:05:30.601565, Affected Rows: 12001
Time: 2024-04-22 21:05:30.611416, Affected Rows: 0 <-- fails already
Time: 2024-04-22 21:05:30.612167, Affected Rows: -1
Executing at 2024-04-22 21:06:30.613892
Time: 2024-04-22 21:06:30.737932, Affected Rows: 12001
Time: 2024-04-22 21:06:30.740307, Affected Rows: 0
Time: 2024-04-22 21:06:30.741570, Affected Rows: -1
Executing at 2024-04-22 21:07:30.743420
Time: 2024-04-22 21:07:30.854913, Affected Rows: 12001
Time: 2024-04-22 21:07:30.856737, Affected Rows: 0
Time: 2024-04-22 21:07:30.857663, Affected Rows: -1

So this seems to relate to prepared statements and how CrateDB treats them.
Psycopg3 with default settings automatically will prepare statements if they are run more than 5 times on a connection, if not explictily disabled. This prepared statements seem to behave strange when used with CrateDB. It almost seems like CrateDB is keeping a state about what partitions are affected from a prepared statement, but never updates it. This can be replicated with the following code example which does roughly the following:

Create a partitioned table
Prepare and run DELETE statement -> nothing gets deleted as the table is empty
Fill table with records
Refresh table just to be sure
Run same DELETE statement again -> nothing gets deleted, but the table is not empty :exploding_head:
lets wait 15 seconds and try again ...
Run same DELETE statement again -> nothing gets deleted, but the table is not empty :exploding_head:

Code Example
import asyncio
from datetime import datetime
import psycopg

# SQL statements for database operations
CREATE_TABLE = """
CREATE TABLE IF NOT EXISTS scheduler_issue.base (
    ts TIMESTAMP,
    ts_g GENERATED ALWAYS AS date_trunc('minute', ts)
) PARTITIONED BY (ts_g);
"""

INSERT_DATA = """
INSERT INTO scheduler_issue.base (ts)
SELECT ts
FROM generate_series(
    date_trunc('minute', now()),
    date_trunc('minute', now() + '1 minute'::INTERVAL),
    '5 seconds'::INTERVAL
) g (ts);
"""

DELETE_OLD_DATA = """
DELETE FROM scheduler_issue.base
"""

REFRESH_TABLE = "REFRESH TABLE scheduler_issue.base;"

async def run():
    # Database connection details
    user = 'crate'
    password = ''
    database = 'crate'
    host = 'localhost'

    # Connect to the database asynchronously
    conn = await psycopg.AsyncConnection.connect(
        dbname=database, user=user, password=password, host=host)
    print("Connected to the database.")

    try:
        async with conn:  # Using the connection within an async context manager
            async with conn.cursor() as cur:
                # Executing SQL commands
                await cur.execute(CREATE_TABLE)
                print(f"Table created")

                #await asyncio.sleep(30)

                await cur.execute(DELETE_OLD_DATA, prepare=True)
                print(f"Run prepared delete first time on empty table, Affected Rows: {cur.rowcount}")

                await cur.execute(INSERT_DATA)
                print(f"Data inserted at, Affected Rows: {cur.rowcount}")

                await cur.execute(REFRESH_TABLE)
                print(f"Table refreshed")

                await cur.execute(DELETE_OLD_DATA, prepare=True)
                print(f"Run prepared delete again on filled table, Affected Rows: {cur.rowcount}")

                print("Sleeping for 15 seconds")
                await asyncio.sleep(15)

                await cur.execute(DELETE_OLD_DATA, prepare=True)
                print(f"Run prepared delete again on filled table, Affected Rows: {cur.rowcount}")

    except Exception as e:
        print(f"An error occurred: {e}")
    finally:
        # Close the connection
        if not conn.closed:
            await conn.close()
        print("Connection closed.")

# Running the asynchronous function
asyncio.run(run())

Thanks for reporting @proddata the fix will be available in 5.6.5 and 5.7.1 releases.


MKL can't be linked with Anaconda(Python 3.8.8)

Hi@all,
i can not import DevSIM after installing "devsim_win64_v1.6.0" with pip. There is allways the following Error
from .devsim_py3 import * ImportError: DLL load failed while importing devsim_py3: Modul not found
Running the "install.py " gives the following:

Python Version 3.8.8
WARNING: Intel MKL could not be dynamically loaded.
WARNING: If you are using Anaconda/Miniconda, please issue this command:
WARNING: conda install numpy mkl
WARNING: mkl_rt.dll not found in CONDA_PREFIX
INFO: Writing C:\Software_Script\devsim_win64_v1.6.0\lib\setup.py
INFO:
INFO: Please type the following command to install devsim:
INFO: pip install -e lib
INFO:
INFO: To remove the file, type:
INFO: pip uninstall devsim

If I change Line28 in the "install.py"
from             'Windows' : {'mkl' : 'mkl_rt.dll'},
to                 'Windows' : {'mkl' : 'mkl_rt.1.dll'},
the warning is gone.
I've figured out, the all MKL related DLL's have this *.1.dll look.
Is there a way to solve this strange linking, without copying/modifying all DLL's ?
Thx in advance for ideas and commernts
Ronny

Thanks for reporting this.  It appears that Intel MKL has started versioning their libraries:
https://software.intel.com/content/www/us/en/develop/documentation/onemkl-windows-developer-guide/top/getting-started/shared-library-versioning.html
Even after fixing this script, I anticipate you will have issues because the windows dll would be hardcoded to load mkl_rt.dll instead of mkl_rt.1.dll.  You can test this in python by issuing:
import devsim

at the command line.  Can you please try the following:
conda install mkl==2020.2 numpy

This will install the older version of the mkl, with mkl_rt.dll.  Please let me know if this works for you.
In a future version, we will need to consider including the mkl runtime libraries as part of the distribution, or updating to the newer mkl_rt.1.dll in our next release.
If you have any general questions about using the software, please join our forum at https://forum.devsim.org

Hi Tcaduser,
thx for your reply. Downgrading my Anaconda installation was not as easy as I thought.
But finally the MKL2020.2 worked.
Thx again.

You should keep a backup copy of mkl_rt.dll.
While I haven't tested this, you should be able to copy the file to devsim_win64_v1.6.0/lib/devsim/ so that you can use newer environments with a different mkl version.
In the next release, I'll be sure to build against mkl_rt.1.dll.


unknown error when using PT Run

Microsoft PowerToys version
0.67.1
Installation method
PowerToys auto-update
Running as admin
Yes
Area(s) with issue?
PowerToys Run
Steps to reproduce
#24228
Reposting since no help has been provided
✔ Expected Behavior
No error
❌ Actual Behavior
Error
Other Software
N/A

Can you please upgrade to latest 0.73 and verify if the issue still occur?
/needinfo

Sorry for not coming back to this, ive not had the error in a while, one of the updates has fixed the issue, thanks.


Beyond Ignite 2.0

Now that we're into the final week for Ignite 2.0 (beta), I'd like to turn a little of the focus on Ignite 2.1. The most important thing in my opinion has to be getting the app templates fully integrated with React Native's templating system and discussing and refining the new infinite-red-app-template (formerly known as "Unholy"). Emphasis on the latter.
The decisions made in infinite-red-app-template, or the IR-AT for short [I'll just go ahead and coin that now], are probably 6-9 months old at least. We've made a few new discoveries along the way and there are some new things that have come out, including the new react-navigation. Time to align our visions for IR-AT.
In this issue, I'd like to discuss priorities for 2.1 and beyond. @GantMan, @skellock, @kevinvangelder,  @robinheinze and I will be having a short meeting tomorrow AM and will put some notes in here, and we can discuss async going forward from there.

review @jamonholmgren  and @skellock and @kevinvangelder
Proposed Roadmap of 2.0
Ignite 2.0:

React Native Maps (generator/plugin)
ignite.addAndroidPermission function (needed for maps)
significant testing end to end
some framework of permutation testing
Video
Testing
Blog post (I have this half written)
website copy

Ignite 2.1:

Early detection testing against FB master (Travis daily CI)
Promo video
Reactotron plugin
Redux Persist plugin
Choose AVA or JEST plugins
apisauce plugin
update listview generator to have experimental option

Ignite 2.2:

play nicely with RN templates
Themes OR Component Styles options
Enforce standard JS with githooks plugin
RNRF or React Navigation plugins
Drawer or No generator?

Ignite 2.3:

Choose Sagas or Epics plugins

Ignite 2.4

Redux or MobX

If these are agreed upon.  They should become tickets with proper tags and set to a milestone.  That way we use Github to manage release items.

Thanks for the giant list!
I think we should only plan for 2 steps ahead.
We all are pretty clear about what the next goal is.  And usually that means we can put things off to the goal after that.... but more than 2 out gets a bit fuzzy.
I think the tests are in a good spot.  @jamonholmgren and @robinheinze are running a bit more with that angle.
Marketing stuff is all you @GantMan.  I spun up a few tasks, but you're already on top of that.
Navigation, I feel is a discussion first.  We all want react-navigation, but I don't think anyone is going to stamp it with "fit for client consumption" today.  That team is firing correct though.  Maybe next week it'll be good enough?  Hell, I haven't used it in a 2 weeks.  Maybe it is good now?
Feel free to add more tasks:

Mark 'em as type: discussion & without a milestone if you want to get the ball rolling.
Mark 'em with the Future milestone if you feel like we need this.
Mark 'em with 2.1 if you feel like need this now.

Thanks @jamonholmgren for rallying us.


Handle Null Refresh Token in Token Refresh Flow with Amazon Cognito

Description
When issuing an OAuth2 token request with grant_type=refresh_token to servers like Amazon Cognito, a new access_token and optionally a new id_token are returned, but no new refresh_token is provided.
In the current TokenRefreshHandler implementation, a new refresh token is explicitly expected in the response. If it’s not present (as is the case with Cognito), the refresh_token is set to null. This causes subsequent grant_type=refresh_token requests to fail, as the handler no longer has a valid refresh token to use.
Proposed Solution

Add a nullability check for the returned refresh token in the TokenRefreshHandler.
If the refresh token in the response is null, retain and reuse the previously used refresh token instead of removing it.

Steps to Reproduce

Configure the application to use Amazon Cognito as the OAuth2 provider.
Perform a grant_type=refresh_token token request.
Observe that the returned refresh_token is null.
Attempt another grant_type=refresh_token request — it will fail due to the null refresh token.

Expected Behavior
The handler should retain the existing refresh token when the server does not return a new one, ensuring that subsequent refresh requests continue to work as expected.
Impact
This issue causes token refresh flows to fail with providers like Amazon Cognito, disrupting functionality for applications relying on these flows.
Additional Notes
This behavior aligns with Amazon Cognito's standard implementation, as it typically does not provide a new refresh_token with a refresh request. Adjusting the handler logic will ensure compatibility with Cognito and similar providers.
Please consider prioritizing this fix to support a broader range of OAuth2 providers effectively.

You are correct, this is currently handled incorrectly.
As per RFC 6749:
The authorization server MAY issue a new refresh token, in which case
the client MUST discard the old refresh token and replace it with the
new refresh token.
Thanks for the fix, i will release a fixed version asap.


Error while loading Sveltia CMS start page

With the update to 0.34.4 or 0.34.5, I'm getting the following error when loading up the admin site:

0.34.3 still works:

My config.yml: http://udvarfeszt.hu/admin/config.yml
I'm guessing the YAML parser update in 0.34.4 went south, but I'm not sure yet.

Seems like the config.yml can be reduced to just:
backend:
  name: github
  repo: test/test

media_folder: 'images'

collections:
  - name: 'sections'
    label: 'Sections'
    files: []

and it still doesn't work. Also, I have error in the latest version of both Firefox and Chromium.

Hmm, will check.

Just shipped v0.34.6 with the fix. Sorry about that 🙇🏼


Update README.md

Added nano Jammer

Thanks for contributing.
Is the duplicated NYOP tag of neko a typo?
Consider using newline instead of the comma to separate consoles.

Oops, yes! I was using the inline github editor and it was hard to see the
code clearly. I'm very sorry!
-m
Prof. Morgan McGuire
Computer Science Department
Williams College
http://cs.williams.edu/~morgan
On Thu, Aug 16, 2018 at 1:10 AM Wang Renxin<EMAIL_ADDRESS>wrote:

Thanks for contributing.
Is the duplicated NYOP tag of neko a typo?
Consider using newline instead of the comma to separate consoles.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/paladin-t/fantasy/pull/11#issuecomment-413462552, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ADyT4vyiMCBBvqAqJbMRPBJAy060a_K6ks5uRSj1gaJpZM4V_XzX
.


installation procedure should follow standard pip procedures

The installation step:

pip install -r https://raw.githubusercontent.com/aid4mh/QPrism/main/requirements.txt

downgraded many of my Python packages including scipy and pandas and caused a few dependency conflicts. Are greater than or equal to (e.g. pandas>=1.2.4) versions in the requirements.txt possible?

Please use the versions mentioned in the requirements.txt file.
Could you please let us know where you experienced dependency conflicts?

The dependency conflicts are related to other packages I have on my system for which the installation of QPrism causes problems.
As an example the QPrism install does this:

Attempting uninstall: pandas
Found existing installation: pandas 1.4.2
Uninstalling pandas-1.4.2:
Successfully uninstalled pandas-1.4.2
Successfully installed ... pandas-1.2.4

Which results in an issue with another package already installed on my system.

pyripherals 0.0.2 requires pandas>=1.3.1, but you have pandas 1.2.4 which is incompatible.

Similarly, the installation of QPrism downgraded numpy (1.23.1 to 1.21.6) and scipy packages which I heavily rely upon and prefer to have up to date.
I'm OK with the installation of a package upgrading packages I already have installed. However, downgrading packages I already have is an undesired behavior.

Thank you for letting us know! We have updated the Readme instructions for installing QPrism. Please create a virtual environment before installing the package.
Follow the steps given here: https://github.com/aid4mh/QPrism/blob/main/README.md


Add dexie to whitelisted dependencies

This adds Dexie to the whitelisted dependencies to be able to merge https://github.com/DefinitelyTyped/DefinitelyTyped/pull/37160.

This is in production now.


all: Refactor for new subscription API

This is mostly in a good place, but there is one major sticking point: wallet.NewManager.
With the old API, when a call to cm.AddBlocks returns, all of the subscribers will have finished processing the new update(s). With the new API, this is not true; the processing happens asynchronously. This broke some tests which expected that, after calling AddBlocks, they could immediately observe the effects of those blocks in wallet state. Now, they can't, so we need a way for the test to wait until processing has finished. In most of the tests, I worked around this; see the syncDB helper I added. But that approach doesn't work when you have a real wallet manager running. For now, I faked the waiting with time.Sleep, just to see if that makes the tests pass (it does), but clearly we need a better solution.
The whole asynchronous processing thing really bugs me, so much so that I tweaked the new API to release the chain manager's lock before calling the onReorg listener functions. This means it's now legal for your listener function to call chain manager methods -- meaning, you can implement subscription "the old fashioned way" and have your onReorg function directly call UpdatesSince in a loop until it's caught up. Effectively this brings us back to the same situation as before, except that the manager is no longer locked, so you have a bit more freedom. (And of course, you can still do async processing if you want.)
But the other big wrinkle here is the wallet manager's Subscribe method. Previously, it unsubscribed from the chain manager, then resubscribed at a lower height. Firstly, it's not clear to me why this would work; won't you end up with duplicate state? But more importantly, we need to nail down how this action ought to interact with the wallet manager's ongoing subscription in the new API. In my PR code, we hold the wallet manager's lock while syncing, so Subscribe effectively pauses the background subscription until it's finished. Not exactly pretty, but it gets the job done. Is there a better way? That's what I'm not sure about.

I faked the waiting with time.Sleep

That's how hostd and renterd tests work as well. It's not great, but it works (most of the time).

Previously, it unsubscribed from the chain manager, then resubscribed at a lower height. Firstly, it's not clear to me why this would work; won't you end up with duplicate state?

State can't be duplicated in the SQLite store. If a subscriber tries to create an element that already exists, it silently fails and continues processing. Same for deletion/spending. If the element doesn't exist, it silently fails and continues processing. I think the one place this might currently bite us is on merkle proof updates in index mode. We don't track which updates we've processed, we just add to tree.
In the old API, we could rely on the chain manager locking to guarantee all updates would be seen. This new API may cause problems with that assumption if a reorg gets skipped when rescanning. I think there are a few ways we could solve that if my understanding is correct.

I rebased this to get rid of the CI errors


Picker list with Search option

Hi NativeBase is great library to work with. I am using picker component and I have long list to show under picker item list, is there any option or work around to show search box and filter through it the item list.

@sagark1510 Hey, Glad to hear that you appreciate our work.
We dont have component which is a combination of Picker and Searchbox.
But you can customize it at your own using NB SearchBar

Ntivebase picker is awesome. there is only thing is missing in the component is search if it is there then it will be cool


bn.nansum on boolean array

Is this behavior expected?
In [1]: import numpy as np

In [2]: import bottleneck as bn

In [3]: arr = np.array([True, True, False])

In [4]: np.nansum(arr)  # cast from bool -> int
Out[4]: 2

In [5]: bn.nansum(arr)  # no upcasting
Out[5]: True

I'm not sure what bottleneck's goals are are w.r.t upcasting output types.

The C code in bottleneck is only called for int32, int64, float32, float64. Everything else goes to the corresponding python version of the function. In this case: bn.slow.nansum.
Unlike numpy, bn.nansum doesn't return int64 when input is int32. That explains the if statement in bn.slow.nansum.

@TomAugspurger I pushed a fix to master:
In [1]: bn.nansum([True, True, False])
Out[1]: 2
In [2]: bn.ss([True, True, False])
Out[2]: 2

Thanks!
On Tue, Dec 12, 2017 at 11:04 AM, kwgoodman<EMAIL_ADDRESS>wrote:

@TomAugspurger https://github.com/tomaugspurger I pushed a fix to
master:
In [1]: bn.nansum([True, True, False])
Out[1]: 2
In [2]: bn.ss([True, True, False])
Out[2]: 2
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/kwgoodman/bottleneck/issues/180#issuecomment-351116878,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABQHImSzm0I7nSmgpjxORYmBEfUpnXHyks5s_rIggaJpZM4Q-LAz
.


Token de acceso al WNS

El CEE ya posee un TA valido para el acceso al WSN solicitado

Is there any way to take control of the request for a new token? I don't know why this happen from time to time.
I found that this error appears when you are trying to get a new token when there is an other valid token. How can i get that valid token and used it intead of asking for a new one?

The app tries to use the latest token (unless there isn't one, or it's expired).
If you're getting this error, it can mean one of two things:

You have two (or more) processes running in parallel, and one fetched a token after another process fetched it, but before it was committed into the DB (this can happen if you have high concurrency).
The token was fetched by some other application. I've seen this issue, for example, in CI, when one run got a token, and the next run tries to get a token (CI runs in a clear environment, so the previous one gets lost). The timeout is a few minutes. Live-testing when clearing the database can be a PITA because of this.

Thanks you, i'll check my processes then! Closing issue.

Sure! If you the issue is lots of concurrent attempts at once, I suggest you use a single task runner for invoice validation and alike.
Let me know if this does end up looking like a bug elsewhere.


[v2.7] net: tcp: possible deadlock in tcp_conn_unref()

From #42526

Hi, as I continue to stress our http server I have found a deadlock related to tcp stack and sockets.
Basically, when the http server is under a decent load racing keeps happening between my http connection thread and tcp stack's rx_q thread when they are both closing the connection at the same time.
What happens is that http server calls close() on socket, which lock its socket lock in z_impl_zsock_close() and continues closing, but releases its processor time before setting the context->recv_cb to NULL . Now the rx_q comes by and proceeds to close the connection from tcp stack POV. Doing so will lock the tcp_lock in tcp_conn_unref() and because of context->recv_cb not being NULL it goes back to socket layer where it starts waiting for the socket lock.
Now the sleeping server thread wakes up and goes to tcp_conn_unref() where the tcp_lock is already taken by previous thread and here is the deadlock.

Weird, this was not automatically closed. I guess because the commit did not include Fixes.


Job_Sequencing_Problem C_CPP

Description 📜
Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context.
Fixes #issue_number_here

Type of change 📝

[ ] Au#dio (Should be in mp3 format Includes speech clarity, Concise ,Low distortion)
[ ] Vi#deo (Animations, screen-recordings, presentations and regular explanatory films are all possibilties etc)
[
[X] Doc#umentation (Content Creation in the form of codes or tutorials)
[ ] Other (If you choose other, Please mention changes below)

Domain of Contribution 📊

[ ] Android Dev #(Flutter)
[ ] Android Dev #(Java)
[ ] Android Dev #(Kotlin)
[ ] Backend Dev #(Java)
[ ] Backend Dev #(.NET)
[ ] Backend Dev #(PHP)
[ ] Backend Dev #(Python)
[X] C/#CPP
[ ] Competitive #Programming
[ ] Cyber #Security
[ ] DS#A
[ ] Data#base
[ ] Datascience with #Python
[ ] Datascience with #R
[ ] Frontend Dev #HTML/CSS/JS
[ ] Frontend Dev #React/Angular/Vue
[ ] Go#lang
[ ] Interview #Prep
[ ] Java_#Domain
[ ] JavaScript_#Domain
[ ] ME#RN
[ ] Machine #Learning
[ ] Open #Source
[ ] Python_#Domain
[ ] Ru#st
[ ] Statis#tics
[ ] UI/#UX

Checklist ✅

[X] I follow Contributing Guidelines & Code of conduct of this project.
[X] I have performed a self-review of my own code or work.
[X] I have commented my code, particularly in hard-to-understand areas.
[X] My changes generates no new warnings.
[X] I'm GWOC'21 contributor

Screenshots / Gif (Optional) 📸

Delete the Qwickshort file as it is not needed.

And add Mark down styling. Here is a link for that.
Markdown Styling

@Saviour1001 please review

Add Markdown styling .... Don't write in plain text, doesn't look good. Use the links provided above

@Saviour1001 please review

@Saviour1001

Looks good to me !!

thanks a lot @Saviour1001


Remove "Carbon" from w3 site page title

The current page title is "Carbon Design System". As part of the Carbon scrub the new page title should be "Product Design"

@alisonjoseph heads up since we don't have a TT epic or tag

The title is being pulled from the config file, so not sure if this is something easily swapped for just the internal site but will take a look.

We need to scrub the whole site. Assigning to the volunteer - Chris Connors!

I don't understand how we can scrub the entire site when our packages are called carbon-components etc and our url is also www.carbondesignsystem.com, the internal and external websites are just one codebase with a few minor differences. This might be a bigger discussion on how we want to handle the name change issues.

I did a search for "carbon" in the website repo and found 3,608 results.

We don’t need to scrub the whole site right now. Let’s remove (if possible, otherwise deemphasize) carbon name references on the internal version of the home page, including nav.
We can address the rest later.

@alisonjoseph this was always about what's surfaced in w3 - package names, etc. is a different problem.

Those links are links to public packages that's why I didn't update the names. The rest of the updates are live internally. (might have to clear cache to see)

@designertyler @jeoffw shouldn't these two items be consistent:

No System on the end. As for whether IBM needs to be in the hero space, I'll leave that to Tyler based on his discussions with Digital et al.

Could the tiles just be named:

Design Kit
Components
Components React
Components Angular
CodePen
Theming Sandbox

Yes, I can update them @jeoffw

Yes to taking out "system" and updating the tiles without "Carbon"
Digital has "IBM" in the header and does not use IBM in this section . They rely on the IBM logo in the top left.
There's no established naming convention (yet). My opinion is that we should use the full "IBM Product Design" when talking about our system to reinforce that it is aligned with the rest of IBM Design and it's the official way to build product at IBM.
We're also inconsistent across the board on how we're using emphasis/bold on "IBM" and "Design".


Create sciencescom.txt

@MaelCormier I am sorry, your university website says now just "Oops, an error occurred! Code:<PHONE_NUMBER>1054ffbfbb27	Oops, an error occurred! Code:<PHONE_NUMBER>1054a778d274Oops, an error occurred! Code:<PHONE_NUMBER>1054f1460acd". I can not check it out now. I will return to it later and satisfy the request as soon as possible. Thank you.

@MaelCormier Problem with the website resolved, however I am not able to find necessary information at the website. Please let me know what is an URL of a page on the official website where an IT-related long-term (>1 year) course is offered by the university.

@MaelCormier You might miss my previous comment. Please reply.

@philipto Hi, sorry for the delay.
This a page that presents a course offered by the school : http://sciencescom.audencia.com/programmes/cycle-master/formation-initiale/
(Sorry it's in french)
It's a media and communication program but with a lot of web development classes. PHPStorm could be very useful for me.
Thank you

@MaelCormier Pull request merged. Thank you for the update!


If email is unspecified, pass in -e ' ' to avoid having registry URL interpreted as email, which will fail cryptically.

If publish.docker.email is unspecified, special-case this to pass in -e ' '.
This avoids having the line end up as 'docker login -u foo -p bar -e someregistry', which is interpreted as 'log in user foo with pass bar and email someregistry to https://index.docker.io/v1/' (c.f. 'docker help login').

This does not work. See the error:
time="2015-04-09T09:45:34-04:00" level="fatal" msg="Error response from daemon: Registration: \"Wrong email format (it has to match \\\"[^@]+@[^@]+\\\\.[^@]+\\\")\""

Hmm, you're right, though I'm not sure what's going wrong; the command that should be produced works when I run it manually:
$ docker login -u someuser -p somepass -e ' ' http://some-registry
Login Succeeded

I first wanted to drop -e entirely if email is omitted, but that makes docker login request it interactively:
docker login -u username -p password https://registry:8000/v1/
Email:

I tried adding a test case in my local clone (should have included it with this PR..) that verifies that omitting email produces docker login -u username -p password -e ' ' https://registry:8000/v1/, and the test passes:
https://github.com/hkjn/drone/commit/69ab9e999299fc2869af24167053c3e9cc1072ae
Any ideas for why the command doesn't do the right thing when drone runs it but appears to work manually would be welcome..

if email is omitted, but that makes docker login request it interactively

Good catch. That means my change I was doing wouldn't work either.

Any ideas for why the command doesn't do the right thing when drone runs it but appears to work manually would be welcome..

I am not 100% sure, but I think echo eats up quotes at  https://github.com/drone/drone/blob/master/shared/build/buildfile/buildfile.go#L57

Hmm, I'm not sure either, but I don't think the BuildFile.WriteFile method is being called here.. the BuildFile.WriteCmdSilent method just seems to call WriteString on the backing bytes.Buffer inside BuildFile., and the same object eventually writes its Bytes() to disk, without any further changes to the contents that I can see:
https://github.com/drone/drone/blob/master/shared/build/build.go#L528
I tried setting up a test case in github.com/drone/drone/shared/build/build_test.go as well (not submitting a PR since I had to comment out the echo '#DRONE:%x' line in buildfile.go, which produced diffs otherwise which I couldn't understand), which
also verified that the file written to disk contains the intended line, with quotes intact:
docker login -u testuser -p testpassword -e ' ' https://test-registry

So TL;DR, I don't know why it's not working when actually run by drone; all manual and unit tests seem to say it should.. I could try changing it to double quotes (-e " ") instead, but that seems superstitious..

Thanks for looking in to that @hkjn. It is not a blocking bug I guess. I use private registry with drone, so I just put a dummy email address to .drone.yml and it works fine.

Yeah, same, so I guess it's no worse than before..

Agreed.


Clean up Interfaces

There has been no refactoring of the interfaces in the library, ever, and they are out of hand. Working on the library is slower than it should be because of the technical debt, and the type-safety is at risk when making changes (there are no tests that exhaustively prove that internal changes do not break consumers by changing the external contracts).
Some things are duplicated, and it not clear which interface should be used where.
Non-exhaustive list of things to check:

Default Generic parameters for parameterised client / workers are duplicated.
ActivatedJobs come back from the gRPC call to the Broker. Job Interface has the JSON parsed variables and custom headers.
Configuration interface for workers versus constructor interface versus createWorker interface.
Separate external contract interfaces into their own named file to make potentially breaking changes clear.

WIP: Moved gRPC interfaces to interfaces-grpc.ts and some public interfaces to interfaces-published-contract.ts

That's all I'm doing on this for now.


Update senddata.py - initialize BME680 via I2C addresses

Avoid following error:
Traceback (most recent call last):
File "senddata.py", line 56, in
sensor = bme680.BME680()
File "/usr/lib/python3/dist-packages/bme680/init.py", line 25, in init
self.chip_id = self._get_regs(CHIP_ID_ADDR, 1)
File "/usr/lib/python3/dist-packages/bme680/init.py", line 296, in _get_regs
return self._i2c.read_byte_data(self.i2c_addr, register)

Looks good to me, thanks! However I cannot test it because I do not run the setup anymore.

Looks good to me, thanks! However I cannot test it because I do not run the setup anymore.


Added support for role assignment for tokens.

Added support for assigning role for token during creation.
Crap, there was already pr about this one, is it still active or do i just close this one permanently?

On one hand, https://github.com/ianunruh/hvac/pull/64 hasn't had any activity. On the other, this PR could use some tests...

Test-case added.

Closing in favor of another PR with more functionality


doc: update coding guideline to suggest to place local imports last

It seems very common in other Go based projects to place the local
packages in the import statement last. Currently Ceph-CSI expects the
imports to group the local packages immediately after standard packages.
This exception compared to other projects often requires new
contributors to 'correct' their PR.
Following a more common convention for grouping imports should make it a
little easier to contribute to the project.

@mergifyio queue


Missing synonyms of CRK in alpha

There are three synonyms for CRK in the production target profile page but none in the alpha version of the rewrite.

Production

Alpha

the API does properly and returns its name synonyms

Based on @mkarmona response:
{
  "data": {
    "target": {
      "approvedSymbol": "CRK",
      "approvedName": "CRK proto-oncogene, adaptor protein",
      "nameSynonyms": [
        "Proto-oncogene c-Crk",
        "p38",
        "Adapter molecule crk"
      ],
      "symbolSynonyms": []
    }
  }
}

it's likely the rewrite app is only using symbolSynonyms, when it should be concatenating symbolSynonyms + nameSynonyms

Done and merged in beta https://github.com/opentargets/platform-app/pull/278
It also fixes the synonyms on evidence page.

Done and merged in beta https://github.com/opentargets/platform-app/pull/278
It also fixes the synonyms on evidence page.


Add MAX_MISSILE_TYPE and remove strcpy warnings

PATCH

Please check if the PR fulfills these requirements

[x] The commit message follows our guidelines
[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)
[x] Norm of the code has been respected

In what state is your pull request?

[ ] Ready to merge / Waiting a reviwer to see my work.
[ ] Work In Progress (WIP) / My work is not finish but i want daily reviews. (Draft)
[ ] CI Review / I want to see what the CI thinks of my work.
[ ] Need feedback / Just to have feedback on what i produced. (May not be merged)

What kind of change does this PR introduce? (You can choose multiple)

[x] Bug fix
[ ] Feature request
[ ] New / Updated documentation
[ ] Testing CI ( Make the pull request in draft mode)

What is the current behavior? (link an issue based on the kind of change this pr introduce)

What is the new behavior (if this is a feature change)?

Other information:

Summary by CodeRabbit
New Features:

Introduced a new missile type in the game, expanding the gameplay options.

Bug Fixes:

Implemented a safeguard in the missile creation process to prevent the use of invalid missile types, enhancing game stability and preventing potential errors.

https://github.com/X-R-G-B/R-Bus/pull/143


Questions Regarding Instructions #8 and #10

想请教一下作者，关于实践经验的两个问题，还望不吝赐教：

第八条中“对于垂类模型，或许我们更应该关注PT的过程，而不是采集千万百万的SFT数据做训练，我们的建议是大规模预训练+小规模监督微调=超强的LLM模型；”，请问这里的“大规模预训练”是指继承通用大语言模型参数还是在垂类上预训练呢？“小规模监督微调”如何解决通用语言模型无法理解垂域专有词汇或背景知识不足的问题呢（目前是 RAG，但感觉效果还不够好）？如果以医疗chatbot 为例，这里的“千万百万的SFT”指的是人工标记的问答么？
第十条中“预训练可以灌入知识，监督微调只是激活领域能力(无法关注知识)？预训练的知识与监督微调知识应该呼应？预训练几十GB的语料知识会被原来数万亿token预训练的模型知识淹没？”请问这里的“预训练几十GB的语料知识”中的“预训练”实际指的是二次预训练么，即在专用知识库上自回归训练么？“原来数万亿token预训练的模型知识”中的“预训练”实际指的是通用语言模型的预训练么？目前确实观察到了“预训练可以灌入知识”，即全参数的二次预训练可以引入新知识，但是通用语言能力会有损失。请教一下作者，对于有监督微调的数据量、数据选择及训练方式（全参数/LoRA-family）有没有什么经验性的指导意见。

感谢！

I would like to consult the author on two questions about practical experience, and I hope you could kindly provide your insights:

In the eighth article, it is stated that "For vertical models, perhaps we should pay more attention to the PT process, rather than collecting tens of millions of SFT data for training, our suggestion is large-scale pre-training + small-scale supervised fine-tuning = super strong LLM model." Could you please clarify whether "large-scale pre-training" refers to inheriting the parameters of the general large language model or pre-training on the vertical field? How does "small-scale supervised fine-tuning" solve the problem of the general language model not understanding vertical-specific vocabulary or lacking background knowledge (currently it is RAG, but the effect seems not good enough)? If we take a medical chatbot as an example, does "tens of millions of SFT" refer to manually labeled Q&A?
In the tenth article, it is stated that "Pre-training can instill knowledge, and supervised fine-tuning only activates domain capabilities (cannot focus on knowledge)? Should the knowledge of pre-training and the knowledge of supervised fine-tuning correspond? Will the knowledge of tens of GB of pre-training corpus be overwhelmed by the knowledge of the original model pre-trained with trillions of tokens?" Could you please specify whether the "pre-training" in "pre-training tens of GB of corpus knowledge" actually refers to secondary pre-training, that is, autoregressive training on a dedicated knowledge base? Does the "pre-training" in "the original model pre-trained with trillions of tokens" actually refer to the pre-training of the general language model? At present, we indeed observe that "pre-training can instill knowledge", that is, full-parameter secondary pre-training can introduce new knowledge, but the general language ability will be lost. I would like to ask the author if there is any experiential guidance on the amount of data, data selection, and training methods (full parameters/LoRA-family) for supervised fine-tuning.
Thank you!

这里的大规模预训练可以看作是增量预训练。“小规模监督微调”应该注重底座模型能力和监督微调数据的质量。这里的千万百万的SFT指的是任何方式收集来的数据（包括人工制作和其它方法）。
是二次预训练。是指原来通用模型的预训练。通用能力的丧失是必然，看你场景下需要保持怎么样的能力，一般来说全参数微调比LoRA性能较好一点，但是可以主要以LoRA为主，数据以质量为主，数据量在万条以上。


Align the Hashicorp Vault Add-on to CAMEL-20775

Requirement
https://issues.apache.org/jira/browse/CAMEL-20775
We need to remove the engine property, since it's not used anymore.
Problem
We need to remove the engine property, since it's not used anymore.
Proposal
Align once we support Camel 4.7.0
Open questions
No response

We need to do the change in a backward compatible way. Remind that, although the parameter may not be longer used after Camel 4.7.0, the operator can still run previous runtimes version which are making use of that parameter. I think the best approach is to deprecated and eventually remove when we bump to a major Kubernetes API upgrade.

Vaults are deprecated in favor of plain Camel configuration.


ignore file

it would be nice if not all of my 38000+ files in node_modules would be shown as untracked changes. An ignore file would be nice to have, like .fosignore (analogous to gitignore)

The equivalent file is .fossil-settings/ignore-glob, according to Fossil's documentation.

Yes, having an ignore-glob file with patterns to ignore works, and also by using the command "fossil ui" (from a command prompt), you can access settings (Admin -> Settings), and set patterns to ignore, such as node-modules, and in this case, this setting is stored in the Fossil database and no ignore-glob file is needed.  Either way is fine though.  Since this is available in Fossil by default already, I will be closing this.


Improve client tests

What kind of change does this PR introduce?
Improves client tests:

Adds cli arguments which allow a user to override gotrue server url, token and user email, password (so that a dev can test locally while still allowing the CI/CD to perform tests as usual)
Improved type checking via the TypeChecker matcher
Improved gotrue client error output (prints the client error instead of showing Actual: <Instance of 'GotrueError'>
Fixes null check / overrride on signIn test (was causing CI to fail before)

Don't merge this yet. I need to revert the command line args and take a different approach. Probably env vars.

This is updated to use env variables as overrides instead of cli args. Can you approve the workflow test to make sure it still passes?

Hmm, the current failure shouldn't be resulting from anything I changed unless the test was broken before. Any idea whether user.appMetadata['provider'] is supposed to be a String or a List<String>?

I just tried running the test against a live supabase instance hosted by supabase. All tests passed. Not sure why "Get user" test is failing in CI. Is the CI maybe using a non-prod version of the supabase or gotrue server?

@point-source
Thank you so much for all the amazing jobs you have been doing!
It seems like there was an update on the Gotrue repo that changes the return type of provider meta data. This seems like a breaking change, so I'm asking the team if this update will actually go live on Supabase or not right here. Let's hold off on making any decisions until we get an answer!

So there is going to be a breaking change on the server's end that will change the type of user.appMetadata['provider'] from String to List<String>. They are testing it out in staging environment at the moment, and that is why we have a failing test. The breaking change is not yet live on Supabase, but they plan to release it sometime during October.
Given all that, I'd say let's merge this PR since there's only one failing test that is due to the breaking change and fix the breaking change in another PR once the breaking change is officially announced, but what do you think @bdlukaa?


Wrong calculation

So I came across a wrong calculation result.
252+ SpA Choice Specs Duraludon Thunderbolt vs. 252 HP / 124 SpD Pyukumuku on a critical hit: 174-206 (53.7 - 63.5%) -- guaranteed 2HKO after Leftovers recovery (both lvl 50)
I got 1HKO
This is the smogon calculator which looks right to me:
252+ SpA Choice Specs Duraludon Thunderbolt vs. 252 HP / 124 SpD Pyukumuku on a critical hit: 174-206 (107.4 - 127.1%) -- guaranteed OHKO

You clearly have Dynamax enabled, the actual HP calculation 174-206 are identical.


Also update username when credentials are updated

During an upsert of server credentials, if the username changed, it needs to be updated as well.

Thanks for the review @joelrebel, updated the test as well.


Use offset BSS and DATA section starts

One of those things that took two weeks to debug, then only 6 small line changes...
BSS and DATA section starts should be relative, not absolute. This means
fixing the linker script portion that populates the binary header, as
well as the assembly that initializes bss/data.
Currently only fixed and tested for RISC-V, this almost 100% requires
adjustments for ARM as well, just haven't done it yet.

Also note that this does not seem to work after rebasing with master---i.e. with the async version of the libtock-rs. I haven't debugged yet.
This PR is currently here for feedback and status updates. It shouldn't be merged yet.

What is the status of this PR? Have you made the necessary changes to the ARM assembly? If not, would you like help?

Can we close this PR? There has been no activity on this PR for more than two months now.

I don't think this is necessary for RISC-V

As this PR has been inactive for half a year now I will close it. Feel free to reopen the PR.

The /* Offset of BSS section in memory */ and /* Offset of data section in memory */ comments should change, since they are fixed addresses and not offsets. This PR made them into offsets, but if libtock-rs is never going to support relocatable apps then there isn't a need to make them offsets.


feat: Autocompletions for Config Block

Description
It would be helpful to implement autocompletions when working inside the config block. This would enhance the developer experience by providing suggestions and reducing potential errors while writing configurations.
Proposed Solution

Add a method to check if the user is currently inside the config block.
Use a JSON schema of the config block for the Language Server Protocol (LSP) to enable autocompletions.

Considerations

The JSON schema for the config block would need to be maintained to reflect changes in Dataform updates.

To build dependencies to dataform version, we should probably not enforce validation at this point, just add autocompletions based of the latest release.

What's the thoughts on this, something we should look into?

Hi, I had a brief exploration of the idea including implementing an MVP. My thoughts so far

I like the idea
The fact that we need to check are we in the config block on each character we type does not sit right. Although it can be an operation that runs in low 2 digits milliseconds
Out of most people I have seen using the extension most people copy paste the config. I personally have been using the config block snippets for table / view / operation depending on what I need. That said, I usually need to check what are the different types of assertions / bigquery options  available by going to the docs. This could be streamlined
Would something like snippets be better. e.g. prefix the snippet with config-assert.. it gives you a template with all assertion options and same for others. Using snippets will mean hopefully less code to maintain and minimal performance impact
From a user experience perspective I want it to be as non-laggy as possible. I personally, use an M2 Mac so extension works very fast on my laptop. But on the other hand some of my colleagues use windows where I can see noticeable lag in loading web views among others.

Happy to discuss further

Hey @ashish10alex ,
Thanks for testing and your thorough explanations.
I agree with you on more or less all points.
I as-well most often copy an existing config or use the snippets.
But often need to look up a syntax in the docs or by looking at another model.
I also agree that speed is important, if it appears laggy even if just a little it's most likely not worth the win.
I believe the feature would need to support ctrl + space or similar command to get a list of possible values.
Snippets would be messy if you're editing an already existing config block I believe?
Let's say I would like to add a updatePartitionFilter to an already existing bigquery config
Could we possibly only activate the autocomplete inside config on ctrl + space rather than on each typed letter?
Or maybe a workaround could be some kind of hover that displays the schema?
I know to little about vscodes lsp, I'll do some research tomorrow 🙂

You point regarding snippets makes sense. ctrl + space trigger seems like a good direction to go. I'd say build an MVP of what you have in mind and we can always evaluate user experience / speed etc. But this is something that will be great to have.

Hey @ashish10alex
I've done some testing aswell now and reached the same conclusion as you mentioned:

The fact that we need to check whether we are in the config block on each character we type does not sit right. Although it can be an operation that runs in low 2 digits milliseconds.

Unfortunately, it doesn't seem possible to activate the registerCompletionItemProvider only on hotkey press.
To move forward, I see two potential options:

Add a setting to toggle config-autocomplete:

This would allow users to turn off the config block lookup if it causes noticeable lag.

Introduce hover functionality for the config block:

We could start by adding hover-based documentation, similar to this example (but with more details):

Let me know your thoughts or if there's another direction you'd like to explore

Hi @HampB , thanks for looking into it. I'd lean on starting with option 2. as it's easy to remember the top level keywords but harder to recall the nested keys.  Also, this is something we could build with minimal performance impact.
Option (1), we can have but it will be a very hidden feature + has to false by default. Also, once it's turned on there is high probability that user forgets to turn it off and starts thinking that their editor is clunky/slow when using the plugin / vscode. Also, lets use option (1) for at least a month and see our own personal experience using it.


Does not export data

Hey Guys,
I don't know if this is a bug or the feature is not implemented, but on the market it says: "This plugin is a multi-purpose tool to manage your Strapi database records through JSON files", but the database records are not exported actually. Is this plugin useful for exporting the entries as well? When I add a new record and I Retrigger an export, it says: [notice] There are no changes to export.
THanks

It really depends on what kind of records you are creating. By default just 4 types will be tracked. Please read the config types section of the readme. If you want to track other type of records you can register them through the customTypes plugin config. Also documented in the readme.

I'm using just very regular content types, say the default User type, and create a single user. Even that is not exported.

Ok, maybe we are talking about different things, I'm talking about records not types, for example the default boilerplate comes with a User type, when you create an specific user (eg, user John Doe, with relevant fields), those types of data are not exported.

I think you might misunderstand the use of this plugin. I would like to redirect you to this article to get some more insight.
Quoting from the article:

This plugin is not for all your database records. It is really meant for those config tables of which the records are mainly created/updated by the developer, not by the client. You are free to use this plugin for any table you want, but by default, 4 tables are tracked.

If you are looking for a full-on database dump, exporting everything without continuous graceful imports you might be better of using the native data management system.

Got it, thanks for that.


No such function within the flex project

Hi, I found that there is an API main2 to test within flex project, as shown in
https://github.com/google/oss-fuzz-gen/blob/b96e9fe6334f2a0aaf83b119339dc0aa30c69b9a/benchmark-sets/all/flex.yaml#L2
However, there doesn't seem to be such a function in this project, and experiments to generate drivers for it always fail.
Can you confirm whether it's a typo (perhaps the correct one is main) or any other problem that's causing this?

@DavidKorczynski @DonggeLiu can you please take a look?

This happens because the OSS-Fuzz build for flex patches the main function to enable analysis: https://github.com/google/oss-fuzz/blob/74e3c9413ac02ea72bc3be161096a390f05de846/projects/flex/build.sh#L26 As such, there is a main2 function in the binary artifacts build by the OSS-Fuzz set up, and this is the one reported.
Likely this happens because flex is not a library as such but more of a command line application, and the libfuzzer engine has its own main function, so any other mains need to be silenced.
I can think of a few solutions but they all seem a bit hacky.


simple function without stdin for opencpu API test

This adds a simple function that accepts a string as argument. This is mostly for opencpu testing purpose.

All tests passed. Any objections that I merge this? @hsonne


Add basic webpack for JS bundle

This is only a first stab at adding webpack bundling for our JS here. I know we could load up more through this, like our styles, but I'm unsure of the immediate benefit to that.
Also want to use this as a brief opportunity to figure out if webpack is the right choice here, or if Rollup or something else is. I'm still familiarizing myself with some of the tooling and concerns around requiring the transpilers since the regular imports we have here today seem to work.

Webpack is a good choice, most of the time Rollup is used to build libs and Webpack is used a lot

Does this really need a webpack config file?
We could use use the webpack cli.
  "config": {
    "src": "./assets/js/src",
    "dest": "./assets/js/dist",
    "presets":"@babel/preset-env",
    "plugins":"@babel/plugin-proposal-optional-chaining,@babel/plugin-proposal-function-bind",
    "mode":"production",
    "targets":"browserslist:modern",
    "ignore ": "",
  },
  "scripts": {
    "babel": "babel $npm_package_config_src --out-dir $npm_package_config_dest --presets=$npm_package_config_presets --plugins $npm_package_config_plugins",
    "js": "npx webpack serve --entry $npm_package_config_src/starter.js  ---output-path $npm_package_config_dest --mode development",
    "js:prod": "npx webpack --entry $npm_package_config_src/starter.js  ---output-path $npm_package_config_dest  --env prod --env min",
  },

Something like this could also help solve #21 by using the built in dev server which has live reloading. Also the babel task is meant to give users more controller over their JS targets and runs before webpack.

At least with webpack we could deploy the starter compiled files somewhere (index + css + js) without copying all the node_modules directory or loading resources manually. However, compiling can take time when there are a lot of files, shouldn't be the case for npm-starter.


Faster setup (so i can run tpu tests)

@rjpower the tpu tests aren't your fault. i think they're fixed in main


time.Date return wrong when get Weekday for 12 December 2019

What version of Go are you using (go version)?

$ go version
go version go1.12.7 darwin/amd64

Does this issue reproduce with the latest release?
yes
What operating system and processor architecture are you using (go env)?
go env Output
$ go env
GOARCH="amd64"
GOBIN=""
GOCACHE="/Users/miun/Library/Caches/go-build"
GOEXE=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="darwin"
GOOS="darwin"
GOPATH="/Users/miun/golang"
GOPROXY=""
GORACE=""
GOROOT="/usr/local/Cellar/go/1.12.7/libexec"
GOTMPDIR=""
GOTOOLDIR="/usr/local/Cellar/go/1.12.7/libexec/pkg/tool/darwin_amd64"
GCCGO="gccgo"
CC="clang"
CXX="clang++"
CGO_ENABLED="1"
GOMOD="/Users/miun/learn/bootcamp-kumparan-academy/mini-project-backend-2/go.mod"
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fdebug-prefix-map=/var/folders/7b/0b4h2f9n03772j3zmby5xhth0000gn/T/go-build393908295=/tmp/go-build -gno-record-gcc-switches -fno-common"

What did you do?
I want to get first day of 12 December 2019

package main

import (
	"fmt"
	"time"
)

func main() {
	loc, _ := time.LoadLocation("Asia/Jakarta")

	currDay := int(time.Date(2019, 11, 1, 0, 0, 0, 0, loc).Weekday())
	// expected 5 (Friday) correct
	fmt.Println("first day of 1 November 2019", currDay)

	currDay = int(time.Date(2019, 12, 1, 0, 0, 0, 0, loc).Weekday())
	// expected 7 (Sunday)
	fmt.Println("first day of 1 December 2019", currDay)
}

check https://play.golang.org/p/zbEokKYouc8
What did you expect to see?
I expect to get 7 (sunday)
What did you see instead?
but got 0

Sunday is 0. See the docs:
https://golang.org/pkg/time/#Weekday

Oh, i see thanks