Machine Learning for audio classification

Proposed title of article
Your title should be descriptive of the article/tutorial. Be Specific. Use keyword research to gain your article higher ranking.
Machine Learning for audio classification
Introduction paragraph (2-3 paragraphs):
In this tutorial, you'll get an introduction to Machine Learning for audio classification and also some of the theory that is needed to understand it. We will also be implementing audio classification by using the TensorFlow machine learning framework. We will be taking into account a raw audio dataset and categorized it into speech and music. Followed by pre-processing, creating, and training a deep learning model to perform classification. This way we can classify incoming audio in one of the two classes, in either speech or music.
Key takeaways:
What are the 3-5 most important things the reader should understand or be able to do after reading this article? Use this area to get your ideas down on the bulk of your article or tutorial.
By the end of this tutorial a reader should be able to:

Set up the working environment.
Perform data exploration
Create a spectrogram
Perform data pre-processing
Create the model
Train the model
Make predictions

References:
Please list links to any published content/research that you intend to use to support/guide this article.
Templates to use as guides

How To Guide Template
Software Review Template
Tutorial Template

Good afternoon and thank you for submitting your topic suggestion. @Bayler
Your topic form has been entered into our queue and should be reviewed (for approval) as soon as a content moderator is finished reviewing the ones in the queue before it.

Great topic 🚀 , make sure it matches the following:

Adds value beyond what is in the official docs and what is covered in other blog sites.
To avoid potential article closure, it should not overlap with existing EngEd articles or incoming topic suggestions.

Please reference any relevant EngEd articles in yours and build a unique project - Approved. @Bayler

Hi @Bayler  I am interested to take up this exercise. Please let me know if you can assign it.

Hi @sridhatta do you mean to review?

I mean for creating the article.

This one has already been issued. Please submit another topic issue that is different from this one.

Closed #3474 via #3634


Update connector-troubleshoot-guide.md

Added troubleshooting guide for "Failed" message when creating managed private end point.

@ssabat : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Hi @ssabat - This pull request was opened in the public repo. PMs should work in the private repo, per the Microsoft Docs contributor guide. We can keep this PR and your other existing PRs open for review and merge in the public repo, but would you make future content updates in the private repo? Let me know if you need information about working in the private repo. It's described in the internal contributor guide, but I can also send you the information via email. Thank you!

@ssabat This change is dup with your other PR 66095. Please close.


get-opts uses argv when nil is explicitly passed as argument

This seems to not match up with the behavior described in its docstring which states:

If OPTIONS is given, it should be a list to
parse. If it's not given, the function will use `argv' function to get list
of command line arguments.

This led me to believe that argv would only be used when the optional argument wasn't passed, not when nil was passed as the optional argument.
I can submit a pull request if you'd like, but I wanted to get your thoughts first since this change would potentially be breaking.

I agree that this wording is a bit unfortunate, and that changing it would be better. But as versioning in common lisp is not really that common I think that a breaking change would not be the best solution, but instead rewording it is better. I understand that it is really annoying that you cannot pass an empty list to the method, so we would have to think of workaround for that.

Yeah, I figured you'd want to play it safe but I figured I'd ask. Once I figured out the issue I was having, it was easy enough to do (when args (opts:get-opts args)) as a workaround since if you're wanting to give it an empty list, you're expecting back an empty list.

I think a form of helper function would be nice, so that any default arguments can still be parsed. Something like a special (defun possibly-empty (args) (if args args 'empty-list).

You mean to be used like (opts:get-opts (possibly-empty args))?

Maybe a keyword argument for specifying how an empty list/nil should be handled would be more idiomatic?

Sorry for my absence, but when looking at the code it seems like we already do this, when options is supplied it is used, even when it is nil. So I'm not entirely sure what is happening.

You're sure right, at the time I made this issue I was accidentally using an older version that was cloned by another project's makefile, but I see it's been fixed since. Sorry about that!


Update components that render conditional on dataset (part 1)

Many components render differently based on the current dataset. Check for conditionals such as datasetId.startsWith('gnomad_r3').
Ideally, instead of checking the dataset ID directly, abstract checks into functions in dataset-metadata. For example, datasetHasGenomes vs datasetId !== 'exac'.

I still have quite a few instances of this to change, but for strategic reasons I decided to release the first batch of changes while continuing to work on them--see https://github.com/broadinstitute/gnomad-browser/pull/980 for details.


Documentation fix?

usage: az cosmosdb collection create [-h] [--verbose] [--debug]
                                     [--output {json,jsonc,table,tsv,yaml}]
                                     [--query JMESPATH]
                                     [--resource-group-name DB_RESOURCE_GROUP_NAME]
                                     [--name DB_ACCOUNT_NAME]
                                     [--key DB_ACCOUNT_KEY]
                                     [--url-connection DB_URL_CONNECTION]
                                     --db-name DATABASE_ID --collection-name
                                     COLLECTION_ID [--throughput THROUGHPUT]
                                     [--partition-key-path PARTITION_KEY_PATH]
                                     [--default-ttl DEFAULT_TTL]
                                     [--indexing-policy INDEXING_POLICY]
                                     [--subscription _SUBSCRIPTION]

It would seem that in most of these instances --database-id needs to become --db-name for this page's documentation.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 7d791e10-4181-cf15-1398-499eb0918c9c
Version Independent ID: 2e5f864d-29bd-da4f-b964-a87a39f988c0
Content: az cosmosdb collection
Content Source: src/command_modules/azure-cli-cosmosdb/azure/cli/command_modules/cosmosdb/_help.py
Service: cosmos-db
GitHub Login: @rloutlaw
Microsoft Alias: routlaw

@mindlessroman thank you for submitting an issue. I am not sure if that page has changed since you submitted the suggestion, but I do not see --database-id referenced on the page. Are you referring to "DATABASE_ID" following the --db-name parameter?

I am going to close this issue for now. I do not see where --database-id is referenced on that page. If you have a specific example of where it is used, you can re-open the issue, and we can work on correcting it if needed. Database Id is another term for the database name, so these can be interchangeable in documentation.


Query on Eventual Consistency Mechanism

Hi @amantinband!
Firstly, thank you for this amazing project! It's packed with fantastic features. 🙌
However, I have a question regarding how eventual consistency is ensured. If I understood correctly, domain events are stored in the HttpContext Items and then processed after the response is sent to the client. In the event of a server breakdown, wouldn't there be a risk of inconsistency?
Wouldn't it be more advisable to implement an outbox pattern for such scenarios?
Thank you!

Hey @tiagofvital! The code snippets in the README.md are a simplified. Here is the full implementation:

As you can see above, all the changes made in the scope of a single request are wrapped inside a transaction.
This transaction is only committed after all side effects took place. Meaning, that in the worse case scenario, If error handing wasn't designed resiliently, the user will think everything happend successfully since they will get a 2XX response, but the changes won't be stored in the database.

Got it! 👍 In that case, I'm a bit uncertain about the advantages of this approach compared to dispatching domain events before calling dbContext SaveChanges. Using the Create Subscription feature as an example, wouldn't it be acceptable to have something like:
var subscription = new Subscription(request.SubscriptionType);

var user = new User(
    request.UserId,
    request.FirstName,
    request.LastName,
    request.Email,
    subscription);

await _usersRepository.AddAsync(user, cancellationToken);

await _usersRepository.UnitOfWork.SaveChanges();

return SubscriptionResult.FromUser(user);

This would be an alternative way to handle it. What are your thoughts?"

Got it! 👍 In that case, I'm a bit uncertain about the advantages of this approach compared to dispatching domain events before calling dbContext SaveChanges. Using the Create Subscription feature as an example, wouldn't it be acceptable to have something like:
var subscription = new Subscription(request.SubscriptionType);

var user = new User(
    request.UserId,
    request.FirstName,
    request.LastName,
    request.Email,
    subscription);

await _usersRepository.AddAsync(user, cancellationToken);

await _usersRepository.UnitOfWork.SaveChanges();

return SubscriptionResult.FromUser(user);

The unit of work would then dispatch the domain events after committing changes in the dbContext.
This would be an alternative way to handle it. What are your thoughts?"

In his course, he discusses the advantages of dispatching domain events after the main operation. This approach primarily enhances user experience by providing a perceived performance boost. When domain events are dispatched post-operation, the user isn't kept waiting for all the side effects and event handling to complete. This is particularly beneficial in a microservices architecture where some side effects might depend on other services.
If these services are down, the system can still return a success response to the user, while a retry logic works in the background to handle the events once dependencies are back online. This not only improves the system's responsiveness but also its fault tolerance. However, it's important to consider the additional complexity this might introduce, especially in terms of failure handling and maintaining data consistency.

Right, @IsItBroken gave the full answer ❤
The difference is this line:
https://github.com/amantinband/clean-architecture/blob/09605637026f5e05375969b4fedb6c797dabe736/src/CleanArchitecture.Infrastructure/Common/Middleware/EventualConsistencyMiddleware.cs#L16
The entire process happens only after the user gets the response

Closing this issue. Feel free to reopen if you have further questions

Hi @amantinband!
What happens when there is a crash before committing the transaction? Wouldn't the client application wrongly receive a success status?


Make integration documentation consistent with each other.

This is a prep PR for #26201.
It just makes sure that the spacing and numbering in the list are consistent for each integration documentation. So that it can help in future refactoring of the documentation.

Self-review checklist

[x] Self-reviewed the changes for clarity and maintainability
(variable names, code reuse, readability, etc.).

Communicate decisions, questions, and potential concerns.

[ ] Explains differences from previous plans (e.g., issue description).
[ ] Highlights technical choices and bugs encountered.
[ ] Calls out remaining decisions and concerns.
[ ] Automated tests verify logic where appropriate.

Individual commits are ready for review (see commit discipline).

[x] Each commit is a coherent idea.
[x] Commit message(s) explain reasoning and motivation for changes.

Completed manual review and testing of the following:

[ ] Visual appearance of the changes.
[ ] Responsiveness and internationalization.
[ ] Strings and tooltips.
[ ] End-to-end functionality of buttons, interactions and flows.
[ ] Corner cases, error conditions, and easily imagined bugs.

@zulipbot add "area: documentation (api and integrations)" "documentation review"

@sbansal1999 - Looks good to me and confirmed no changes to rendered documentation for these integrations! Marking for integration review.

Merged, thanks @sbansal1999 and @laurynmm!


Demo site broken (and general is this repo still being updated?)

In the readme, there is a link to demos: https://colorpicker.hellopangea.com/ but they don't work.
Also, I see that last update in this repo was in 2022.  I get color pickers only have so many features but I just wanted to verify this is still being maintained.

@Xhale1 do you have an update to provide?


Add 'Scroll into view' option to Source panel context menu for DOM elements

This feature request is part of the larger theme of context menus not being tailor for developer needs in DevTools #50.
By the nature of my current project, I have to manipulate DOM objects, is a sense that execution of the code highly depends on involved DOM object.
So the problem is that If you happen to have a local variable assigned to DOMElement to see where it is located within the document you need to do the following:

Copy variable name
paste it to Console
Hit enter
Open context menu on the result
Pick Reveal in Elements panel
Open Context menu again
Pick 'Scroll into view' half a screen away from the current mouse position from the list of unrelated and visually similar options.

At this point, repeating the command and typing .scrollIntoView() feels line a shortcut. CUI wins over GUI.
Thank you for considering this request.

Thanks for the report. I agree that wherever DOM nodes are displayed, the context menu should offer roughly the same options.
I say roughly because when you right-click on a DOM node in the Elements tool, you get an awfully long list of options, all of which might not be useful when the DOM node is displayed in the Sources tool (for example "Badge settings").
But I totally agree that "Scroll into view" or "Store as global variable" make a lot of sense in other tools.
Just to illustrate, here's the context menu when right-clicking a DOM node in the Scope panel of the Sources tool:

Weirdly enough, the "Store outerHTML as global variable" option is here, and it's not even an option in the Elements tool. Not sure what the value of this is. But it must have been added for a reason.
The DOM node context menu in the Console tool, however, is the same one as the Elements tool one. So that's good.
This actually means you could save 1 step in your list of steps. You can either:

Copy variable name
Paste in console
Hit enter
Open context menu
Choose Scroll into view

Or you could also do:

In Sources tool, right click on DOM node in Scopes pane
Click Reveal in Elements panel
Right-click selected element
Choose Scroll into view.

Not saying these are perfect, but hopefully they save a bit of frustration.
Let me add this to the team's backlog so we can prioritize adding the missing options to the Sources tool context menu for DOM nodes.

Thanks for your reply!
Totally agree on 'roughly the same options'. It is called context menu for a reason :).
It should be based on general idea of why devs are using the tool at all - likely to debug and test code, and quite possibly the code is somehow related to DOM stuff, because otherwise you can do the debugging in vs code.
On top of that it should be adjusted to the thing you are currently looking at and where you look at it.
Thanks for idea with scope panel, it is a bit shorted, but nevertheless, the biggest issue remains: you need to switch you context - move to another panel, loosing sight of the code, do a bunch of action there, and then find your have back to code. Huge waste on metal resources. In this sense typing out '.scrollIntoView()' is actually better, cos you stay in Source panel.

Got it, that makes sense. I actually filed an "upstream" (i.e. chromium) issue for this as this also happens in other chromium-based browsers: https://bugs.chromium.org/p/chromium/issues/detail?id=1322932


Download ZIP from search can't be decompressed.

(The download all submissions zip)
I'd show you the file - but it can't be attached. :open_mouth:
This isn't high priority.

I just tried it and it seems to work fine... does the single-file download work for you? Both methods use identical mechanisms.

Update: It seems to work - but the download all submissions doesn't download all of the submissions - just the ones on the page?

Mhm. That shouldn't happen - I'll investigate.

I just tried doing a single-file download, and I wasn't able to unzip the resulting archive:
Archive:  <redacted>.zip
  End-of-central-directory signature not found.  Either this file is not
  a zipfile, or it constitutes one disk of a multi-part archive.  In the
  latter case the central directory and zipfile comment will be found on
  the last disk(s) of this archive.
unzip:  cannot find zipfile directory in one of <redacted>.zip or
        <redacted>.zip.zip, and cannot find <redacted>.zip.ZIP, period.

Mhm. Which browser were you using? Was <redacted>.zip the name of the resulting file?

I'm using Chrome. Yup, <redacted>.zip is the name of the resulting file.

Mhm. I'll take a look.

Any progress on this? Still can't decompress individual submissions (or any of the archives downloaded from the submission search page, for that matter).

Use safari for now.

Not really sure what to change - I'll update this thread if I find anything though.


Create one Allure report per attempt, without overwriting

Previously, we overwrote the data of the previous attempt, which would result in us losing access to information of previous runs.

arbitrary failures in the pipeline

https://github.com/neondatabase/aws/pull/66 + some deployment work hopefully helps drastically with that

Previously, we overwrote the data of the previous attempt, which would result in us losing access to information of previous runs.

We don't exactly overwrite data but extend the latest runs with results with previous runs; if you open any test in https://neon-github-public-dev.s3.amazonaws.com/reports/main/release/3473978290/index.html#suites/3de20ced56df482626cff043a3f2c817 and switch to Retries tab, you see results from previous runs.
Also, there's a button that shows only tests which changed their result in the latest retry

Here's an example of the test with a changed result:
https://neon-github-public-dev.s3.amazonaws.com/reports/main/release/3473978290/index.html#suites/ec4311502db344eee91f1354e9dc839b/6c8546f56d1cdbdf/retries
Does this help?


See progress & outcome of actions in portainer (such as pulling images)

Is your feature request related to a problem? Please describe.
Currently, there is no way to see the progress of asynchronous tasks in Portainer, in the case of pulling or uploading images this can take a long time. If you browse off to another view you can miss the error messages quite easily.
Describe the solution you'd like
A way to view an overview of asynchronous tasks and their outcomes, such as a dashboard that could pop up from the bottom of the browser window with the click of a button or arrow. This should be accessible from any view in Portainer for convenience.
Additional context:
Previous issue description:

Hi, I'm currently using portainer on my raspberry pi and pulling (and extracting) images can take some time over a slow connection.
In my case >5 minutes. I avoid doing this over portainer as there is no way to see whats happening.
So for this task I have to go back to the shell and pull images via the 'docker pull ...' command.
It would be nice if the progress of the currently running pulls would be visible somewhere, after switching the page, the small spinning gear is in my opinion only feasible for fast actions.
Thanks
Tobi

I agree with that and I've always thought about adding this. IMO it should go further than just see the progress of pulling images, but being able to see the current asynchronous tasks in Portainer (pulling an image, starting a container...)

+1

Yea, kinda sad when the best way to monitor an async task, or to find out why an error is occurring in authentication is to sudo strace -s 4096 -f -p $(ps -ef | grep /portainer |grep -v grep |awk '{print $2}')
This is a great app, but visibility into what is happening under the hood, even logging, is lacking.

Research
Found this topic. It contains some examples of docker sdk usage, with code in Go, Python or using curl.
The following example can be usefull on how to achieve what we want for image pulling real time progress tracking.
@deviantony
Regarding this need: being able to see the status of asynchronous tasks in Portainer , some of the actions give data in real time (for example pulling images), but some don't (starting a container).
We may need to list all the actions that we want to track in real time, and see if the docker api allows us to do so for every action.

We're only gonna tackle the pullImage operation stream with this issue.
You shared an example on how to use the SDK to pull an image, Portainer is interacting with the Docker API directly (via https://docs.docker.com/engine/api/v1.39/#operation/ImageCreate which is super undocumented).
This API endpoint actually streams a response and I wonder if we can handle it in the frontend or if we need to add an evolution on the backend to support this.
Here is an interesting link about this API endpoint: https://stackoverflow.com/a/54559180/1127536

Re-purposing this issue to cover the overview and monitoring of async tasks in Portainer

Hey, we don't currently have this in our roadmap, so there is no ETA on this at the moment unfortunately.

Hi,
would like to have this too. Any way to upvote this feature?..

As a temporary solution, we could add a small console output window below the button and just show the basic console output of docker right? It is not really elegant but it would show us all the required information and should not be too hard to implement.

As a temporary solution, we could add a small console output window below the button and just show the basic console output of docker right? It is not really elegant but it would show us all the required information and should not be too hard to implement.

Implemented??

Implemented??

I do not think so.

Implemented?

Still no way to see progress?

Any update on this?

Any update on this?

6 years and this highly requested feature is still nowhere to be seen with minimal feedback from the developers. At this point unless somebody implements it and creates a PR I do not think we are going to live to see this feature added.

+1 for this, when deploying a stack, we have no way to know what's going on.
When you run docker compose up in the shell, you get some feedback for what is happening (pulling, extracting, starting).
This is a must because you have no way to know if eveything is working as intended until portainer is done with the task or an error pops up

New user from 30mn ago an totally agree ;)


about mem usage

Hi,
Can bolt run in a embed device of mips 32bit cpu with 32M ram?

I haven't tried it but I don't see why not. I'd be interested to hear if you try it.


Using attention networks when each utterance is a sequence of vectors without a lookup table.

I am not sure how to modify the example for either of the reverse_words or machine_translation examples to be able to use it with a dataset to do say speech synthesis.
There is no lookup table for each phoneme/character and each utterance maybe of dimension [num of frames x feature dimension]. So say utt1 is say dimension 700  x 50, utt2 is 600 x 50 etc.  At each time I would like the encoder to see the entire utterance sequence without using a  lookup table .
Is there a simple pointer on how to train an attention network with this kind of input?
I am stuck with mainly the following:

How to load this kind of data into a file using fuel, since all the examples I have seen so far are converting it to one stream where it iterates over rows, when I need it to iterate over matrices with variable number of rows.

If I do use the stream how to make the attention network know the end of utterance without using a lookup table or  an eos tag. Instead of a row vector can I give a matrix as input to it?

Any pointers would be helpful.

The issue tracker is for problems encountered with the code as it exists today. This is a research question, about (as far as I know) an open research question, and pretty clearly out of scope.


Expose test summary information

Great work on this formatter! 👍🏻
It would be great if you could expose also the test summary information:
Executed 2 tests, with 1 failure (0 unexpected) in 0.266 (0.268) seconds
Thank you!

I'm a bit busy lately.  It shouldn't be to hard, since xcpretty probably exposes the summary.


Add a new feature selection method

Add a new feature selection method of 'explain_instance_with_data' method witch can select fixed features.

#2


UTF-8 Encode/Decode Error Handling

Describe the bug
Custom search commands exception out when non UTF-8 event data is present in the search pipeline
To Reproduce

Create a custom command
Pass non UTF-8 field data to the custom command (feel free to use invalid_utf8.csv)

Expected behavior
splunk-sdk-python (and all other potentially impacted SDK's) should handle encoding/decoding in the same manner as Splunk Core.
Logs or Screenshots

Not working
broken_search.log

After patching six.py

Splunk (please complete the following information):

Version: 8.2.5
OS: Windows 10 Pro 19045.2486
Deployment: single-instance

SDK (please complete the following information):

Version: 1.7.2
Language Runtime Version: Python 3.7
OS: Windows 10 Pro 19045.2486

Additional context
My patch - to get my command working ASAP - was to change errors='strict' to errors='replace' here.  I chose replace since it mimic's the functionality of Splunk.  I didn't touch any other instances of errors='strict' and only tested this against StreamingCommand.
This bug is not limited to the inputlookup command but it is the easiest way to reproduce.

@ashurack we are unable to reproduce the issue and were able to successfully upload the given csv file. below is the screenshot for the same

Note- here we are using a Streaming CSC. No modification is being applied to the data read from the csv file.
Request you to share your CSC if possible. Also do let us know if something is being missed from steps to reproducing the issue

Looks like the csv file I uploaded is 100% valid UTF.  I'll try to get a sample that will trigger the decoding issue this week.  Message me on Splunk Slack in the meantime for more details.

Hi @ashah-splunk, same error here (Splunk 9.0.1, Debian GNU/Linux 11, Python 3.7.11). Loading events from CSV doesn't work as expected (non UTF characters are parsed to UTF). I am using botsv3 dataset and getting the same problem as @ashurack using vt4splunk streaming command from VT4Splunk. The suggested solution by @ashurack seems to work properly.

Event example:

Error:

search.log:

ERROR ChunkedExternProcessor [1549763 ChunkedExternProcessorStderrLogger] - stderr: UnicodeDecodeError at "/opt/splunk/etc/apps/TA-virustotal-app/bin/ta_virustotal_app/aob_py3/splunklib/six.py", line 917 : 'utf-8' codec can't decode byte 0x8e in position 294568: invalid start byte
ERROR ChunkedExternProcessor [1549763 ChunkedExternProcessorStderrLogger] - stderr: Traceback:
ERROR ChunkedExternProcessor [1549763 ChunkedExternProcessorStderrLogger] - stderr:   File "/opt/splunk/etc/apps/TA-virustotal-app/bin/ta_virustotal_app/aob_py3/splunklib/searchcommands/search_command.py", line 780, in _process_protocol_v2
ERROR ChunkedExternProcessor [1549763 ChunkedExternProcessorStderrLogger] - stderr:     self._execute(ifile, None)
ERROR ChunkedExternProcessor [1549763 ChunkedExternProcessorStderrLogger] - stderr:   File "/opt/splunk/etc/apps/TA-virustotal-app/bin/ta_virustotal_app/aob_py3/splunklib/searchcommands/streaming_command.py", line 55, in _execute
ERROR ChunkedExternProcessor [1549763 ChunkedExternProcessorStderrLogger] - stderr:     SearchCommand._execute(self, ifile, self.stream)
ERROR ChunkedExternProcessor [1549763 ChunkedExternProcessorStderrLogger] - stderr:   File "/opt/splunk/etc/apps/TA-virustotal-app/bin/ta_virustotal_app/aob_py3/splunklib/searchcommands/search_command.py", line 855, in _execute
ERROR ChunkedExternProcessor [1549763 ChunkedExternProcessorStderrLogger] - stderr:     self._execute_v2(ifile, process)
ERROR ChunkedExternProcessor [1549763 ChunkedExternProcessorStderrLogger] - stderr:   File "/opt/splunk/etc/apps/TA-virustotal-app/bin/ta_virustotal_app/aob_py3/splunklib/searchcommands/search_command.py", line 948, in _execute_v2
ERROR ChunkedExternProcessor [1549763 ChunkedExternProcessorStderrLogger] - stderr:     result = self._read_chunk(istream)
ERROR ChunkedExternProcessor [1549763 ChunkedExternProcessorStderrLogger] - stderr:   File "/opt/splunk/etc/apps/TA-virustotal-app/bin/ta_virustotal_app/aob_py3/splunklib/searchcommands/search_command.py", line 912, in _read_chunk
ERROR ChunkedExternProcessor [1549763 ChunkedExternProcessorStderrLogger] - stderr:     return metadata, six.ensure_str(body)
ERROR ChunkedExternProcessor [1549763 ChunkedExternProcessorStderrLogger] - stderr:   File "/opt/splunk/etc/apps/TA-virustotal-app/bin/ta_virustotal_app/aob_py3/splunklib/six.py", line 917, in ensure_str
ERROR ChunkedExternProcessor [1549763 ChunkedExternProcessorStderrLogger] - stderr:     s = s.decode(encoding, errors)
ERROR ChunkedExternProcessor [1549758 localCollectorThread] - EOF while attempting to read transport header read_size=0
ERROR ChunkedExternProcessor [1549758 localCollectorThread] - Error in 'vt4splunk' command: External search command exited unexpectedly with non-zero error code 1.
ERROR LocalCollector [1549758 localCollectorThread] - SearchMessage orig_component=LocalCollector sid= message_key= message=Error in 'vt4splunk' command: External search command exited unexpectedly with non-zero error code 1.

@pabloperezj sorry for the delay in response. We were able to reproduce the issue using botsv3 dataset.  Also during our verification we found that issue occurs only for certain specific non-utf8 characters. We are validating the change suggested by @ashurack and accordingly will make the changes in the SDK.
We will update you know once we have a new SDK release available with the change.

@ashurack ,@pabloperezj the fix is available in the latest Python SDK v1.7.4, request you to pull the latest SDK release. Please re-open the issue if the issue still persists. Thanks!


🎠:feat:Created the Project Carousel Section #71

Created the Project Carousel Section
#71
Type of change
Please delete options that are not relevant.

[x] New feature (non-breaking change which adds functionality)

Screenshot (optional)

Checklist

[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules

Good work, but the code would have been cleaner to fetch the data from a .ts file. And the conflict is caused by re writing the index.html file


Travis: fetch all symengine's pull requests

That way the symengine_version.txt can reference a commit that is only
available in a symengine's pull request that is not merged yet. This allows to
test a proposed change and its Ruby wrappers.

Looks good. Can you add this to appveyor as well?

#31 adds this to appveyor


Checking current_user fixes #6452

@ethervoid CR this, please.
Also fixes this error if new editor is the first thing you open:
 NameError in Carto::Editor::VisualizationsController#show
uninitialized constant Carto::Api::VizJSONPresenter

Retest this, please.

:+1:

Retest this, please.


Linebreaks inside html5 tags

Hello. I am trying to port our usage of github-markdown to redcarpet and notice a difference in the parsing. I wonder if this is a bug or intentional, and if so if there is a workaround.
This script produces different outputs like below:
str = "
<address>
Something address
Something 4C
2620 Blabla
</address>
"

p Redcarpet::Markdown.new(Redcarpet::Render::HTML.new(hard_wrap: true)).render(str).html_safe
p GitHub::Markdown.render_gfm(str).html_safe

=>

"<address>\nSomething address\nSomething 4C\n2620 Blabla\n</address>\n"
"
<address>
\nSomething address
\nSomething 4C
\n2620 Blabla
\n</address>
\n"

I would like the linebreaks to be there.

Hi @soma,
Unfortunately as per the Markdown specs, we aren't doing any processing inside HTML blocks. You'll have to implement a custom render to handle this specific case:
class CustomRender < Redcarpet::Render::HTML
  def block_html(raw_html)
    case raw_html
    when /<address>/
      raw_html.strip.gsub("\n", "
")
    else
      raw_html
    end
  end
end

I'm giving it a close, thanks for spotting this!


running npm run build.static fails on empty dist folder

Qwik Version
0.10.
Operating System (or Browser)
Windows / Chrome
Node Version (if applicable)
16.15.0
Which component is affected?
Qwik Rollup / Vite plugin
Expected Behaviour
To be able to generate SSG on a blank starter project
Actual Behaviour
REPRODUCE:

Generate a new project
Run qwik add and choose static site generation
Run npm run build.static
See failure:

npm run build.static

> build.static
> vite build --ssr src/entry.static.tsx

vite v3.1.1 building SSR bundle for production...
transforming (42) src\global.css"basename" and "relative" are imported from external module "path" but never used in<EMAIL_ADDRESS>and "src/entry.static.js".

✓ 44 modules transformed.

server/entry.static.js   197.63 KiB

[Error: ENOENT: no such file or directory, open 'C:\dev\workspace\websites\qwiksite\dist\service-worker.js'] {
  errno: -4058,
  code: 'ENOENT',
  syscall: 'open',
  path: 'C:\\dev\\workspace\\websites\\qwiksite\\dist\\service-worker.js'
}

Additional Information
The dist folder is not being generated and it seems as if rollup is trying to load the service-workere file from there.
This is happening on a brand new project, no code was added
(It ran on Windows if it's relevant )
maybe related to #1488 (and maybe not)

This should be fixed now in the upcoming release, thanks


Curl download failed

I had trouble downloading some package. Can't remember which one it was. To fix it i add a ~/.curlrc config file with the following entry: --cipher rsa_rc4_128_sha

Would be good to know which package it was. I'd like to verify this because I think it's an issue on the remote end. I prefer to not restrict the cipher list...

ok ... i'll try to revert the change and check which package actually failed to download.

changing ~/.curlrc is not the root of the problem. After a clean build its seems like jack-server is failing due to memory issues. so this is not related to this docker image.
Thanks for your help.


How to log out with a customized button or call back function?

I want to log out from a different page other than the page with the default buit in facebook login/out button. How can I achieve that? Can I call some function to log out so it does not have facebook cached credentials anymore and would require user to login through their facebook one more time.

for android there is a PR in review where you can call logout on the button and it will handle this case.. you can heck it out
#105

Thank you! Btw, is there anyway to force user to type username password each time login? basically clear the session btn app and facebook.

its not something i would implement for the button, however you can use the callbacks to achieve this flow.
in your onLogin and/or onLoginFound callbacks you can just call FBLogin.logout() after you have captured the user's information

closing due to inactivity. Also the new way is to use the ref this.fbLogin.logout()


Studio v3 support

Hey, this plugin would be pretty handy for a project of mine. Was wondering if you're planning on updating it for v3 any time soon? :)

any news here?

Bump

For those wondering about the fate of this plugin: https://github.com/sanity-io/hierarchical-document-list/commit/1d9980319f6a63d008af456a270939ffe6625c08
Not long after I raised this particular issue on Slack it was deprecated without any notice, not even here for those still awaiting updates. Disappointing to say the least ...
As I am still reliant on this plugin, there will probably a point in the future that I will have an attempt porting it to v.3. If anyone is willing to have a go, have a look at https://www.npmjs.com/package/@nosferatu500/react-sortable-tree for a more maintained version of the sortable-tree implementation.

We’re potentially looking to migrate from Craft CMS to Sanity and this would help with the transition 🙏🏻

My colleague added a PR https://github.com/sanity-io/hierarchical-document-list/pull/15 with a fully working v3 version. Until the PR is merged you can install it from https://www.npmjs.com/package/sanity-plugin-melting-hierarchical-document-list


InputFunctionException : SyntaxError: unexpected EOF while parsing (, line 1)

Thanks a ton for snakemake, it's great and intuitive!
I think it's related to #432 but I've made a minimal reproducible example to help.

Note that I've initially opened a question on Stack Overflow because I thought it was a usage issue.
However, I've come to think that there is an issue with DRMAA, because the pipeline works fine locally, with --cores 1.
Snakemake version
Note the Snakemake version for which you experience the bug.
Always make sure to try out the latest version before creating a new bug report.
I'm using 5.19.2
Describe the bug
A clear and concise description of what the bug is.
When I run several of my pipelines using --profile drmaa, I get the following error.
InputFunctionException in line 22 of /ifs/research-groups/sims/kevin/snakemake-issue-all/workflow/Snakefile:
SyntaxError: unexpected EOF while parsing (<string>, line 1)
Wildcards:
sample=A

Logs
If applicable, any terminal output to help explain your problem.
The full log output looks like this
Building DAG of jobs...
Using shell: /bin/bash
Provided cluster nodes: 100
Singularity containers: ignored
Job counts:
    count   jobs
    1   all
    2   cat
    3
InputFunctionException in line 22 of /ifs/research-groups/sims/kevin/snakemake-issue-all/workflow/Snakefile:
SyntaxError: unexpected EOF while parsing (<string>, line 1)
Wildcards:
sample=A

Minimal example
I've set up this minimal pipeline that includes dummy files and can be run out of the box.
https://github.com/kevinrue/snakemake-issue-all
Additional context
My --profile drmaa looks like this
jobs: 100
default-resources: 'mem_free=4G'
drmaa: "-V -notify -p -10 -l mem_free={resources.mem_free} -pe dedicated {threads} -v MKL_NUM_THREADS={threads} -v OPENBLAS_NUM_THREADS={threads} -v OMP_NUM_THREADS={threads} -R y -q all.q"
drmaa-log-dir: /ifs/scratch/kevin
use-conda: true
conda-prefix: /ifs/home/kevin/devel/snakemake/envs
printshellcmds: true
reason: true

I've got the same issue on other pipelines, with the difference that all the 'productive' rules run fine, and that the error happens only for the all rule, e.g.
https://github.com/kevinrue/snakemake_alevin_citeseq_10x

Problem solved on Stack Overflow. It was an issue with my Snakemake profile.


Fix for pagination change on Wagtail > 2.5

{% include "wagtailadmin/shared/pagination_nav.html" with items=page_obj is_ajax=1 %}
should become
{% include "wagtailadmin/shared/ajax_pagination_nav.html" with items=page_obj %}
https://docs.wagtail.io/en/v2.7/releases/2.5.html#changes-to-admin-pagination-helpers

With the introduction of Embedded Content in wagtail 1.12 https://docs.wagtail.io/en/v1.12.6/releases/1.12.html#improved-embed-configuration, this package will no longer be maintained.


add option to selectively decode layers

in tippecanoe-decode add option to selectively export individual layers as geojson.
something like
tippecanoe-decode -l <layername>

OK, this should work in https://github.com/mapbox/tippecanoe/pull/376. (Still need to add tests.)

Merged


[Question] Why "PROMPT_VERSION=plain" is used for both llama-2 and vicuna-v1.3 in the pretraining script ?

Question
I noticed that "PROMPT_VERSION=plain" is used for both llama-2 and vicuna-v1.3 in the pretraining script.
Why not using "PROMPT_VERSION=v1" for vicuna-v1.3 and "PROMPT_VERSION=llava_llama_2" for llama-2 in the pretraining script? While the finetuning script does so...

Have you solved the issue? I am using vicuna-13b-v1.5

We simplified the pretraining prompts by removing additional instructions like Describe the image details, which we find to allow the zero-shot inference and can slightly improve the training speed.
https://github.com/haotian-liu/LLaVA/releases/tag/v1.0.1


ixed a cursor leak in the stake set_votes function

Change Description

Consensus Changes

API Changes

Documentation Additions

will be fixed in #872


Feature/craig/lint checking

Task/Issue URL: https://app.asana.com/0/488551667048375/1176263457388604
Tech Design URL:
CC:
Description:
Adds ability to automate code formatting checks using ktlint.
Steps to test this PR:

Install develop first and run the app. Then install this version to ensure no migration issues from the change (a DB entity class was renamed because it violated the code style)
Run ./gradlew ktlint and verify there are no reported violations.
Deliberately add a violation to a Kotlin class (e.g., add a bunch of useless new lines) and run ktlint again. This time, verify the build fails and reports the issue.

ℹ Note, the Bitrise checks do not yet enforce these rules. There is a new workflow ready to go but I can't switch to using that until this is merged. Once this is merged, I'll configure Bitrise to start failing on new violations.

Internal references:
Software Engineering Expectations
Technical Design Template

@CDRussell thanks for submitting this, it's a great addition. I've got a couple of questions:

Are there any different rules between this and our current style guide? If so, can we have that updated too?
Did you look into enforcing these rules before pushing the code too? Other projects have something like that and could save up a lot of time

Are there any different rules between this and our current style guide? If so, can we have that updated too?

It should be mostly the same, though i'm sure we'll find some further tweaks required at some point. As a result of the commits tidying up the existing code, there should be no changes made if you format the entire codebase in Android Studio now. And so any new detections should be valid.
The one thing that stood out was that it detected a lot of files didn't end with a new line, which is recommended. I don't know if there's a way to get Android Studio to enforce this too for an even quicker alert.

Did you look into enforcing these rules before pushing the code too
No, I considered it but wanted to just get the minimum done to start getting value from it. Agree that it's a good addition though, and happy to iterate on it to make it a strong requirement / prerequisite to format the code locally with a git hook etc...

Thanks for the clarification @CDRussell. I can't find that check either (it exists for Java but not for Kotlin) so I agree that this is a good solution for now

Thanks for checking. If it becomes an issue causing lots of noise, we can either:

enforce formatting before pushing [preferable]
ignore that rule


Removal of dmg installer for firefox & chrome

I noticed this in the 9.1 release notes:

Note: Both Google and Mozilla recommend using the pkg installers instead of the dmg downloads for managed deployments. So far, Installomator has provided labels for both. (googlechrome and googlechromepkg or firefox and firefoxpkg, respectively) Since there are problems with the dmg downloads, a future release of Installomator will disable the firefox and googlechrome dmg labels. You should switch to using the respective pkg labels instead.

Rather than remove dmg download labels, could Installomator be updated to also use them for the pkg downloads as well? That would ensure anyone still using them would get continuity should this not know to update their labels.

We can do this and have done so in the past for other software changes.
Here is my reasoning why I would not want to do this: The software installed by the pkg installers is different than the dmg downloads. Both pkg installers also install the extra software for updates. I (and the developers) consider this an advantage for managed deployments, since it removes the necessity prompting the user for this extra functionality.
But since this is change in the software's behavior, I am reluctant to make this change transparent. And administrator might have reasons to not want the update functionality installed and might not notice the change. I breaking the existing labels, will force admins to make a conscious decision, rather than us making it for them.
That said, I am open for discussion on this. (Here, or join the #installomator channel on MacAdmins Slack.)


[Adapter] Allow to configure forks organization

Some people including @GrahamCampbell use a separate organization for keeping there forks but Gush assumes that the forks organization equals the username (thus breaking for some commands).
Add an extra option for all repo configurators to select a different forks-organization.
And update the usage of username for org to use the option, and fallback to the username when it's not set (old configuration).

i am not feeling confortable breaking some preconceptions Gush is based on. This needs more discussion.

In practice you replace this $this->getParameter($input, 'authentication')['username'] with this $this->getParameter($input, 'authentication')['fork-org'] (and fallback to the previous one when no value is set).


Image file can not preview

Issue Type: Bug
Click any images inside project,  the image can not open and preview and directly focus to current file tab.
VS Code version: Code 1.44.2 (ff915844119ce9485abfe8aa9076ec76b5300ddd, 2020-04-16T17:07:18.473Z)
OS version: Darwin x64 19.4.0

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz (12 x 2600)

GPU Status
2d_canvas: enabledflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmetal: disabled_offmultiple_raster_threads: enabled_onoop_rasterization: disabled_offprotected_video_decode: unavailable_offrasterization: enabledskia_renderer: disabled_off_okvideo_decode: enabledviz_display_compositor: enabled_onviz_hit_test_surface_layer: disabled_off_okwebgl: enabledwebgl2: enabled

Load (avg)
2, 3, 3

Memory (System)
16.00GB (0.08GB free)

Process Argv

Screen Reader
no

VM
0%

Extensions (13)

Extension
Author (truncated)
Version

prettier-vscode
esb
4.7.0

flow-for-vscode
flo
1.5.0

vscode-codeql
Git
1.2.0

vscode-test-explorer
hbe
2.18.1

vscode-drawio
hed
0.4.0

vscode-docker
ms-
1.2.0

mssql
ms-
1.9.0

Go
ms-
0.14.2

vetur
oct
0.24.0

typescript-hero
rbb
3.0.0

vscode-leetcode
she
0.16.2

mdx
sil
0.1.0

markdown-all-in-one
yzh
2.8.0

/needsMoreInfo

This happens in Linux VS Code as well. We could not preview images in MarkDown in VS Code.

@zjhiphop Does this reproduce in the latest VS Code insiders build with all extensions disabled?

@matt-deboer That's a duplicate of #98768 which should be fixed in the next insiders build

Closing the original issue since it was reported on an outdated version of VS Code without enough information to investigate further


Rewrite debugging page

@LukeShu please review again - I addressed the changes I could minus the areas where we are waiting for input from @kflynn


Supporting react 18

Hello! Could anyone update it to react 18?

i also need this

is there something in particular preventing support for React 18 or can we just bump the dependencies? Has anybody tried?


RAC: Support removing data-rac attribute

For discussion:
This provides a way to remove the data-rac attribute from elements by passing in null.
✅ Pull Request Checklist:

[ ] Included link to corresponding React Spectrum GitHub Issue.
[ ] Added/updated unit tests and storybook for this change (for new code or code which already has tests).
[ ] Filled out test instructions.
[ ] Updated documentation (if it already exists for this component).
[ ] Looked at the Accessibility Practices for this feature - Aria Practices

📝 Test Instructions:

🧢 Your Project:

Will close until we see a good use case. This breaks the tailwind plugin so I would be wary of documenting it IMO.


stateless functional component form

Since your App component doesn't use state or lifecycle methods, you could replace this:
class App extends React.Component {
  render() {
    return (

with this:
const App = () =>

Ah, very true. Like I said, I'll be refactoring later :-) This was hacked together.

Thanks for the tip!


Tonal v3 - bye lerna

What this PR do?
Remove lerna and sub-packages
Types of changes

[x] Breaking change (fix or feature that would cause existing functionality to change)

Why are we doing this? Any context or related work?
Summary of changes

[x] Remove lerna and setup a flat project structure

Where should a reviewer start?
How has this been tested? How can we test it?
Checklist:

[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[ ] I have added tests to cover my changes.
[ ] All new and existing tests passed.

How's this coming along? I'm liking those commits.

Hi @glhrmv
Thanks! 😄 I think it's almost ready... except the Typescript part. I finally decided to revert the Typescript changes we did some time ago (I'm sorry @rakannimer, you did a great job, but I found that ts at this project creates more problems than it solves... so I'll keep js sources and ts definitions for now...)
Any suggestion is more than welcome!

No worries, it was fun to do 😄
I'm excited about v3 and the flat project structure 👍


flutter doctor should warn if the Android (emulator) AVP version is "old"

flutter doctor currently outputs (something) like this:
% flutter doctor
Doctor summary (to see all details, run flutter doctor -v):
[✓] Flutter (Channel stable, 3.19.0, on macOS 14.4 23E214 darwin-arm64, locale
    en)
[✓] Android toolchain - develop for Android devices (Android SDK version 34.0.0)
[✓] Xcode - develop for iOS and macOS (Xcode 15.2)
[✓] Chrome - develop for the web
[✓] Android Studio (version 2023.2)
[✓] VS Code (version 1.87.2)
[✓] Connected device (2 available)
[✓] Network resources

• No issues found!

We'd like to add a warning in the Android emulator (AVD) version is lower than an expected "newer" version.
We discovered this can be queried via:
% $ANDROID_HOME/emulator/emulator --version
<IP_ADDRESS> (build_id 10594030)

Steps:

[ ] Add a warning for the emulator version
[ ] Work with the Impeller team to verify what that version should be

Context
As we get closer to releasing Impeller on Android, we've discovered that Vulkan and Vulkan Validation Errors were not fully supported, and even worked with the Android team to get bug fixes to avoid emulator crashes.
Emulators are a primary way many developers work on their Flutter application, especially if they are developing for Android, so it will become surprising that (older) emulator binaries crash when we switch the default to --enable-impeller.
/cc @reidbaker @christopherfujino
As I mentioned in the engine weekly, this up for grabs.

Some prior art for required and recommended Xcode versions:
https://github.com/flutter/flutter/blob/1d89ae3f6555028e983e5e567aaabeab153596a9/packages/flutter_tools/lib/src/macos/xcode_validator.dart#L57-L63
https://github.com/flutter/flutter/blob/1d89ae3f6555028e983e5e567aaabeab153596a9/packages/flutter_tools/lib/src/base/user_messages.dart#L167-L173
Note recommended and required are currently the same, but they have diverged in the past:
https://github.com/flutter/flutter/blob/1d89ae3f6555028e983e5e567aaabeab153596a9/packages/flutter_tools/lib/src/macos/xcode.dart#L23-L27

--version I do not think will work
You want -version

Thanks for picking this up Andrew/Chris. If there is anything we can do to help reach out myself or Jonah.

@matanlurey (cc: @jonahwilliams) Barring surprise complications, I think I could implement this pretty quickly. However, what is unclear to me is the threshold is for an AVD version being "outdated" is. Should it be <33.X? <34.X?

I suspect let's just pick the newest AVD as the minimum, and document how/when to bump that number.

As discussed in the most recent Tools & Engine weekly meeting, this is being deprioritized. Feel free to reassign me if this issue becomes more significant.

@matanlurey what's the deadline for getting this in?

@matanlurey what's the deadline for getting this in?

It would be best to add this by the same release that makes Impeller on Android the default.
It's also not critical, like we could just document "use the latest AVD" and prioritize the tool improvements if we see a lot of users complain?
/cc @jonahwilliams


color balls wont show up

i tired kitty, st and alacritty and all same issues
i even set font to hack nerd font

Well you need material font for it

https://github.com/Manas140/dotfiles/blob/main/fonts/Material.ttf


Multi-band example in Jupyter notebook

Multi-band example in Jupyter notebook

There are multiple notebooks in documentation with multi-band examples.  It is a good time to close this issue.


Correct where the HHMI cloud costs go

Follow-up to https://github.com/2i2c-org/infrastructure/pull/3429. As part of that, I had redirected where the HHMI (and all other projects') cloud costs go, and this updates the cluster.yaml to point to the correct place.
Ref https://github.com/2i2c-org/infrastructure/issues/3350

Thanks @consideRatio


Added chapter 2 text

Added chapter 2 text and links. TO DO: Further refine requests for OnLineShop and decide exactly which materials to choose for the MongoDB example (microsoft vs pragimtech)!

ok


Runtime knobs

In CoreCLR, we have a list of knobs which can be specified.
In Mono, we can set some command line arguments (like --optimize=OPT or --gc=[sgen,boehm]) and environment variables (like GC_DONT_GC or MONO_GAC_PREFIX, see also https://linux.die.net/man/1/mono).
I think, it would be cool to have an ability to specify some of knobs/arguments as a part of Job.

Good idea!
It could be a list of process arguments and a dictionary of environment variables.
Hint for potential contributors: we have an Executor class that is responsible for creating and starting the process. Currently the list of extra arguments for mono is set here

Done ;)
You can specify env variables or mono arguments per job now.
Example:
public class IntroCustomMonoArguments
{
    public class ConfigWithCustomArguments : ManualConfig
    {
        public ConfigWithCustomArguments()
        {
            // --optimize=MODE , -O=mode
            // MODE is a comma separated list of optimizations. They also allow
            // optimizations to be turned off by prefixing the optimization name with a minus sign.

            Add(Job.Mono.With(new[] { new MonoArgument("--optimize=inline") }).WithId("Inlining enabled"));
            Add(Job.Mono.With(new[] { new MonoArgument("--optimize=-inline") }).WithId("Inlining disabled"));
        }
    }

    [Benchmark]
    public void Sample()
    {
        ShouldGetInlined(); ShouldGetInlined(); ShouldGetInlined();
        ShouldGetInlined(); ShouldGetInlined(); ShouldGetInlined();
        ShouldGetInlined(); ShouldGetInlined(); ShouldGetInlined();
    }

    void ShouldGetInlined() { }
}

BenchmarkDotNet=v<IP_ADDRESS>70903-develop, OS=Windows 10 Redstone 1 (10.0.14393)
Processor=Intel Core i7-6600U CPU 2.60GHz (Skylake), ProcessorCount=4
Frequency=2742190 Hz, Resolution=364.6720 ns, Timer=TSC
  [Host]            : .NET Framework 4.7 (CLR 4.0.30319.42000), 64bit RyuJIT-v4.7.2101.1
  Inlining disabled : Mono 5.0.1 (Visual Studio), 32bit
  Inlining enabled  : Mono 5.0.1 (Visual Studio), 32bit

Runtime=Mono

Method
Job
Arguments
Mean
Error
StdDev

Sample
Inlining disabled
--optimize=-inline
19.4252 ns
0.4406 ns
0.4525 ns

Sample
Inlining enabled
--optimize=inline
0.0000 ns
0.0000 ns
0.0000 ns

For variables it's very similar:
var variables = new [] { new EnvironmentVariable("VeryNiceKey", "VeryNiceValue") }
Add(job.With(variables));

BenchmarkDotNet=v<IP_ADDRESS>70903-develop, OS=Windows 10 Redstone 1 (10.0.14393)
Processor=Intel Core i7-6600U CPU 2.60GHz (Skylake), ProcessorCount=4
Frequency=2742190 Hz, Resolution=364.6720 ns, Timer=TSC
  [Host]     : .NET Framework 4.7 (CLR 4.0.30319.42000), 32bit LegacyJIT-v4.7.2101.1
  Job-HXYYII : .NET Framework 4.7 (CLR 4.0.30319.42000), 32bit LegacyJIT-v4.7.2101.1

EnvironmentVariables=VeryNiceKey=VeryNiceValue  LaunchCount=1  RunStrategy=ColdStart
TargetCount=1  UnrollFactor=1  WarmupCount=1

@AndreyAkinshin I will add the docs tomorrow. And I will most probably also add .NET Core 2.0 target to BenchmarkDotNet. The problem is that ProcessStartInfo.EnvironmentVariables is available for .NET Core 2.0+. Our goal is to set runtime knobs for .NET Core, without support for .NET Core it makes less sense ;)

Awesome!


[bug] Z-Wave JS external config directory is not populated

Version
Checklist:

[ ] I am not using HomeAssistant. Or: a developer has told me to come here.
[X] I have checked the troubleshooting section and my problem is not described there.
[X] I have read the changelog problem was not mentioned there.

Build/Run method

[X] Docker
[ ] PKG
[ ] Snap package
[ ] Manually built (git clone - yarn install - yarn run build )

zwavejs2mqtt version: 4.2.0
zwave-js version: 7.4.0
Describe the bug
The .config-db directory is not populated. This is because nothing creates the directory. ZWave-JS expects the directory to be created already. After manually creating the directory in my store volume, it gets populated.
To Reproduce
Steps to reproduce the behavior:

Run the docker image
Notice the .config-db is not created or populated.

Expected behavior
The container startup scripts should create the directory automatically, or upstream zwave-js driver should do it.
Additional context
None.

Just asking @AlCalzone If I should create that dir or he could handle it on his side

After upgrading to 4.2.0 none of my zwave entities are available in home assistant and I have a suspicion that this is the cause.  However this page directs me to open a bug report on the home assistant github page not here (which feels a bit wrong as this isn't a home assistant integration esp when using an mqtt broker!).
My log is attached.
_zwavejs2mqtt_logs.txt


BUG: module-info missing for > JDK 9 not usable with jlink

Description:
If I want to package an application for Windows/OSX/... I need to create a jlink distribution of the app which requires that the application and all it's libraries are modularized.
For libraries that means that a multi-release jar is created which includes for > JDK9 a module-info.java.
actual behavior: no module-info.java is present for > JDK 9
expected behavior: module-info inside the already existing multi-release jar is present.
Thank you for this very good component. My target is to create a simple texteditor for very very big files (>100 GB files) which I have to search for patterns. This is actually only possible with VIM/VI on linux. This should be possible as well with javafx and your component.

So RichTextFX depends on ReactFX, UndoFX, Flowless, and WellBehavedFX which are all no longer maintained and will probably not be modularized.
I can however add an Automatic-Module-Name: org.fxmisc.richtext entry to RichTextFX's jar manifest and hopefully that'll help. Otherwise there is also the RichTextFX fat (uber) jar in releases.

I am not speaking about modularizing of the library.
It is enough to just add the module-info.java file sitting in the java9 directory of the multi-release jar.
I can deliver the file because I patched richtextfx to be usable in my modular application and attach it here.

That would be great thanks :-)

I have tried to re-compile with gradle. But gradle is somehow totaly different than maven and therefore I could not get the whole thing compiled.
Place the following content in a file with name module-info.java under the folder 'java9'. After you compile you should get a jar file which includes under java9 the module-info.class.
Here is the content of the module-info.java (I cannot attach the file):
`
module richtextfx.fat {
requires javafx.controls;
exports org.fxmisc.richtext.model;
exports org.fxmisc.richtext.event;
exports org.fxmisc.richtext.util;

}
`
Hopefully it is working. Otherwise I have to dig down the issue why gradle does not want to find the javafx library.

I've released RichTextFX version 0.10.4 could you try it and give me feedback  please.

I have tried the 10.4 version but have not found the module-info.class and therefore jlink is failing.

Like you, I also couldn't get it to work with gradle .... so in the end I did it manually.
Could you please download richtextfx-fat-0.10.4.zip and see if that works (not only for jlink but afterwards during runtime as well).
Note that the zip is actually a jar (which Github doesn't like) so just rename the extension after downloading.

I have tried the lib and basically it is working. But what is missing inside of the module-info.java ( I have forgotten to mention them):
Here is the final module-info.java
module richtextfx.fat {
    requires javafx.controls;

    export org.fxmisc.flowless;
    export org.fxmisc.richtext;
    export org.fxmisc.undo;
    export org.fxmisc.wellbehaved.event;
    exports org.fxmisc.richtext.model;
    exports org.fxmisc.richtext.event;
    exports org.fxmisc.richtext.util;
}

With that module-info the lib is usable with jlink.

Yip, that's what I thought would happen and is why I mentioned the RichTextFX dependencies before ....
Anyway after more manual trickery please try richtextfx-fat-0.10.4.zip and see if this works now. (I expect that there might still be one more tweak ..... ?)

I have tried it and it worked perfectly. Thank you for providing this.
Hopefully you can integrate this file into the gradle build somehow.
Actually I am using richtextfx to create a simple editor which has not file size limit. Similar to VI/VIM. Thank you for this great component.

In case someone interested RichTextFX can be integrated into modular app with awesome Moditect plugin that automates jdeps and jlink commands usage. Configuration is a little bit tricky though, because jdeps somehow generates incorrect modules names for the RichTextFX dependencies. Tested with JDK15. If you're using lower version it may require to play with jdeps --multi-release option.
<properties>
    <bld.compression>2</bld.compression>
    <bld.descriptor>windows.xml</bld.descriptor>
    <bld.distribDirectory>${project.build.directory}/dist</bld.distribDirectory>
    <bld.mainClass>myapp.Launcher</bld.mainClass>
    <bld.modulesDirectory>${project.build.directory}/modules</bld.modulesDirectory>
    <bld.platform>win64</bld.platform>
    <bld.runtimeImagesDirectory>${project.build.directory}/runtime-images</bld.runtimeImagesDirectory>
</properties>

<!-- copies app to the modules dir -->
<plugin>
    <groupId>org.apache.maven.plugins</groupId>
    <artifactId>maven-jar-plugin</artifactId>
    <configuration>
        <outputDirectory>${bld.modulesDirectory}</outputDirectory>
    </configuration>
</plugin>

<!-- copies all (both modularized and not modularized) dependencies to the modules dir -->
<plugin>
    <groupId>org.apache.maven.plugins</groupId>
    <artifactId>maven-dependency-plugin</artifactId>
    <executions>
        <execution>
            <id>copy-dependencies</id>
            <phase>prepare-package</phase>
            <goals>
                <goal>copy-dependencies</goal>
            </goals>
            <configuration>
                <outputDirectory>${bld.modulesDirectory}</outputDirectory>
                <includeScope>runtime</includeScope>
            </configuration>
        </execution>
    </executions>
</plugin>

<!-- injects module-info to specified dependencies  -->
<plugin>
    <groupId>org.moditect</groupId>
    <artifactId>moditect-maven-plugin</artifactId>
    <executions>
        <execution>
            <id>add-module-info-richtextfx</id>
            <phase>package</phase>
            <goals>
                <goal>add-module-info</goal>
            </goals>
            <configuration>
                <outputDirectory>${bld.modulesDirectory}</outputDirectory>
                <overwriteExistingFiles>true</overwriteExistingFiles>
                 <modules>
                     <module>
                         <artifact>
                             <groupId>org.reactfx</groupId>
                             <artifactId>reactfx</artifactId>
                         </artifact>
                         <moduleInfoSource>
                             module org.reactfx {
                             requires transitive javafx.base;
                             requires transitive javafx.controls;
                             requires transitive javafx.graphics;

                             exports org.reactfx;
                             exports org.reactfx.collection;
                             exports org.reactfx.inhibeans;
                             exports org.reactfx.inhibeans.binding;
                             exports org.reactfx.inhibeans.collection;
                             exports org.reactfx.inhibeans.property;
                             exports org.reactfx.inhibeans.value;
                             exports org.reactfx.util;
                             exports org.reactfx.value;
                             }
                         </moduleInfoSource>
                     </module>
                     <module>
                         <artifact>
                             <groupId>org.fxmisc.flowless</groupId>
                             <artifactId>flowless</artifactId>
                         </artifact>
                         <moduleInfoSource>
                             module org.fxmisc.flowless {
                             requires transitive javafx.base;
                             requires transitive javafx.controls;
                             requires transitive javafx.graphics;
                             requires transitive org.reactfx;

                             exports org.fxmisc.flowless;
                             }
                         </moduleInfoSource>
                     </module>
                     <module>
                         <artifact>
                             <groupId>org.fxmisc.wellbehaved</groupId>
                             <artifactId>wellbehavedfx</artifactId>
                         </artifact>
                         <moduleInfoSource>
                             module org.fxmisc.wellbehaved {
                             requires transitive javafx.base;
                             requires transitive javafx.graphics;

                             exports org.fxmisc.wellbehaved.event;
                             exports org.fxmisc.wellbehaved.event.internal;
                             exports org.fxmisc.wellbehaved.event.template;
                             }
                         </moduleInfoSource>
                     </module>
                     <module>
                         <artifact>
                             <groupId>org.fxmisc.undo</groupId>
                             <artifactId>undofx</artifactId>
                         </artifact>
                         <moduleInfoSource>
                             module org.fxmisc.undo {
                             requires transitive javafx.base;
                             requires transitive org.reactfx;

                             exports org.fxmisc.undo;
                             exports org.fxmisc.undo.impl;
                             }
                         </moduleInfoSource>
                     </module>
                    <module>
                        <artifact>
                            <groupId>org.fxmisc.richtext</groupId>
                            <artifactId>richtextfx</artifactId>
                        </artifact>
                        <moduleInfoSource>
                            module org.fxmisc.richtext {

                            requires transitive javafx.base;
                            requires transitive javafx.controls;
                            requires transitive javafx.graphics;

                            requires transitive org.reactfx;
                            requires transitive org.fxmisc.flowless;
                            requires transitive org.fxmisc.undo;
                            requires org.fxmisc.wellbehaved;

                            exports org.fxmisc.richtext;
                            exports org.fxmisc.richtext.event;
                            exports org.fxmisc.richtext.model;
                            exports org.fxmisc.richtext.util;
                            }
                        </moduleInfoSource>
                    </module>
                </modules>
            </configuration>
        </execution>
    </executions>
</plugin>

<!-- generates runtime image -->
<plugin>
    <groupId>org.moditect</groupId>
    <artifactId>moditect-maven-plugin</artifactId>
    <executions>
        <execution>
            <id>create-runtime-image-${bld.platform}</id>
            <phase>package</phase>
            <goals>
                <goal>create-runtime-image</goal>
            </goals>
            <configuration>
                <baseJdk>version=${java.version},platform=${bld.platform}</baseJdk>
                <modulePath>
                    <path>${bld.modulesDirectory}</path>
                </modulePath>
                <modules>
                    <module>myapp</module>
                </modules>
                <launcher>
                    <name>myapp</name>
                    <module>myapp/${bld.mainClass}</module>
                </launcher>
                <outputDirectory>${bld.runtimeImagesDirectory}/${bld.platform}</outputDirectory>
                <compression>${bld.compression}</compression>
            </configuration>
        </execution>
    </executions>
</plugin>

@mkpaz  Great, thanks for that !

we only use the CodeArea and that works out of the box inside a modularized application.
If you are using gradle, I can recommend having a look at https://github.com/beryx/badass-jlink-plugin that helps also in identifying potential conflicts


Update result set to derive spatial data from stored geopackage

v0.4 now stores a copy of the geopackage file as part of the Result Set.
All spatial fields (site_area, site_centroids, etc) should be updated to load relevant data from this geopackage instead.

I believe addressed and available since v0.4.3


Question about ’requirements.txt’ contents

Hello,
I noticed that the requirements.txt file in the project contains multiple different versions of the same libraries, which seems unusual. Specifically, there are duplicate entries for libraries like Pillow and opencv-python with different versions.
Here is an example from the requirements.txt file:
Pillow==9.3.0
Pillow==10.0.0
opencv_python_headless==<IP_ADDRESS>
opencv-python-headless==<IP_ADDRESS>

I'm curious to understand the reason behind including multiple versions of the same library in the requirements file. Generally, it's recommended to specify one consistent version for each library to avoid potential dependency conflicts and maintain consistency.
Could you please provide some context or clarify why this approach was taken? It would be helpful for users like me to understand the rationale behind it.
Thank you for your attention to this matter, and I look forward to your response.

Furthermore, I have found that the versions of opencv-python and opencv-python-headless need to be consistent, otherwise it will result in an error message 'module 'cv2' has no attribute 'gapi_wip_gst_GStreamerPipeline'.

Hi @yonuyeung , thanks for pointing it out. Its an oversight from my side. I'll update the requirements.txt file soon.


docs(alert): fixes

Closes #1027
What I did

Minor updates to the alert docs

Testing Instructions

Verify the changes against the issues outlined in #1027.

Notes to Reviewers

@coreyvickery ready! :) (I also included the patch to the Pagination Style section re: wonky interaction state tables in this PR)


How to add package name to tag?

The current tag only has the version number. I hope the tag contains the package name.

I found that the tag template can be modified in changelog.config, but I don’t know what the placeholder for package name is? Does anyone know?

Hello @gzf6 ,
Seems like the only available template variable is {newVersion}
See here: https://github.com/unjs/changelogen/blob/main/src/commands/default.ts#L121

Hello @gzf6 , Seems like the only available template variable is {newVersion}
See here: https://github.com/unjs/changelogen/blob/main/src/commands/default.ts#L121

Thanks, it seems I can only use fixed names in templates now


Mute/tempbans, etc. durations are 1 second off in bot's messages and DMs

Issue
Every mute, tempban or anything that has a timer always 1 second off.
Example
@ERROR was muted for 2 days (1 day, 23 hours).

I'm not sure exactly what message you're referring to there. The general form for !mute, !ban, etc is

Applied <action> to <user> until <end timestamp> (<time remaining>)

e.g

This issue still applies though. A fix for this would be to use the total duration instead of the time remaining (given they should be the same when creating an infraction).

Even if it's technically inaccurate, I would much prefer that the bot displays the rounded duration (i.e., the duration that the moderator used in the infraction itself).
The OP may possibly be referring to the message from the bot as well.

Why not use discord provided timestamps with the end time?

We already use them for , so you mean for  as well?
I feel that's less useful. In the beginning it will say "in 1 day" and then as time goes by it will say "in X hours" and then as more time goes on it will say "X [units] ago."
I like the duration being just normal static text, I just wish it reflected the actual duration written in the infraction by the moderator (or the bot), rather than a calculation of how much time is remaining (I assume that's what it currently is).

To give some context, the duration in parentheses is calculated after the infraction is added to the database. In a very rare case we had some latency and a 10 minute mute was applied 6 minutes after it was added to the database. In that case we were told the mute will last 4 minutes, which is correct.
That said, it doesn't seem like a very compelling reason to keep this behavior. I'm ok with just using the supplied duration as-is, or maybe we could add a check to make sure the delta is no greater than a few seconds to account for edge cases.

P.S.A I'm surprised this lasted more than 15 min

This is something I've noticed with discord relative timestamps in general. Even if you do time = 0 it will say Dec 31 1969.

This is something I've noticed with discord relative timestamps in general. Even if you do time = 0 it will say Dec 31 1969.

time += 1


FPS Unlock v2.1.0 no longer works as of 2nd June 2023

Tested on videogame version 3.7.
I have an AMD Radeon RX 6800 XT and AMD Ryzen 9 5900X. The memory installed is 32GB DDR4 3600MHz and the game is installed on a PCIe 3.0x4 NVMe SSD. I am running Windows 10 22H2.
The unlocker was working up until yesterday but it does not anymore since one in-game patch download that I noticed. The said patch might have to do something with this or it might not.

Tested on 22h2 and 2004, still working using the newest version

Download 2.1.1, all works perfect

Let me check the most recent version and report back

Thanks @MrZomboED. v2.1.1 works fine for me. Closing this issue.


Allow alternative file systems to be used

Hello!
More background on this: https://github.com/dependents/node-module-lookup-amd/issues/20
I'd like to submit a PR to allow an alternative fs implementation to be passed in via options. When one is passed in, then that can be used instead of node's default fs. This will open up scenarios such as being able use virtual file systems with tools such as union-fs but without overriding node's default implementation which would effect dynamic imports and dependency resolution at runtime.
Would you be open to such a PR?

Looking at the code, I am not sure what the simplest way to achieve this would be.
I'm veering towards creating a factory function, that will execute as an IIFE, with default fs passed in as an argument, then refactoring most of the functions to operate within that paradigm.
Then in order to use this library with an alternative fs you could call the factory function passing your own fs as a parameter..
Maybe I am missing something simple?

PR Submitted #21

Yep it was a bit of a struggle on my part. Thanks for considering :-)

Did you manage to investigate this one any further in the end?

Ah sorry. Maybe one more month


added files

Added files from original repo.

Hi @Vgonma (Victor)!  Thanks for the feedback, just made the requested changes.  I have only missed the forLoop as with the forEach the code wasn't working correctly.


Thread state "timers" are drawn out of the bounds

https://user-images.githubusercontent.com/2725914/211564401-9ed69b6e-50ee-4342-9f83-fd7be695d908.mov

This is now fixed: https://github.com/google/orbit/pull/4760


Haskell art link on comunity page is outdated

The link to the Haskell art group on the community page of haskell.org page points to an archived version of the list. Apparently (better confirm with some actual member :) the list changed to here
The new address is on a subdomain of the same domain, and the old one is working, just inform that the list is archived (very confusing indeed :)

fixed in the new repo.


Adding volunteer hours issue 622

Fixes issue #622
Changes Made:

Made the hours auto save when a new user is submitted
If the event has passed, user hours default to event length, otherwise, they default to none
Added tests for new function
Made the track volunteers page show an accumulation between RSVP'd users and manually added users

 Adding Volunteer with their hours #622


✨ Http Endpoints in .yml

#504  👈
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @RTLS and the rest of your teammates on  Graphite


Show deposit agreement flipper

Fixes #435 , Replaces #504
Adds a configuration option to completely disable the deposit agreement.
@projecthydra-labs/hyrax-code-reviewers

@escowles Feel free to :shipit: when the build goes :green_heart:


python310Packages.garminconnect: 0.1.53 -> 0.1.54

Diff: https://github.com/cyberjunky/python-garminconnect/compare/refs/tags/0.1.53...0.1.54
Changelog: https://github.com/cyberjunky/python-garminconnect/releases/tag/0.1.54
Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[ ] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 220492 run on x86_64-linux 1

2 packages built:

python310Packages.garminconnect
python311Packages.garminconnect


Plugin doesn't work with Zotero 7 setup

Originally posted by @jensenojs in https://github.com/vanakat/zotero-link/issues/10#issuecomment-2184057824

emmm, and i can't use it and all.
i also installed zotero bridge, am i missed sth?

@jensenojs I've moved your question into the new issue.
I have just tested plugins on your versions/setup and it works for me.
Could you please check if you have enabled Local API in Zotero 7?
It's in Zotero 7 > Settings > Advanced > Allow other applications on this computer to communicate with Zotero
See screenshot below:

Originally posted by @jensenojs in https://github.com/MunGell/ZotServer/issues/5#issuecomment-2184059720
@MunGell Thanks for your work. I wonder if zotero-link works with zotero7 now?
my obsidian version : Version 1.6.3 (Installer 1.4.13)
zotero version : 7.0.0-beta.91+3c6625f3c
zotero-brigde and zotero-link already update to latest, mac m2 air

am i missed sth?
https://github.com/vanakat/zotero-link/issues/10#issuecomment-2184057824

I've just updated README to add this installation prerequisite.

it works!


Can't use shadow or border in MX Player Subtitle

The problem is when i use them it is a white outline of a white text so that make it unreadable and trying to change the color doesn't change a thing because black turned to white and white is still white so there's no black border for the text or even a little dark color

The actual implementation is not controlled by DarQ, this is not a problem I can solve. Please read the FAQs.


reputation reward tooltip without numbers

This tooltip should have some kind of number, i guess it is a currency.

Added in https://github.com/ItsJustMeChris/idTip-Community-Fork/releases/tag/11.0.30


Build Issues: Widnows Server 2008 R2

Attempting to build gainput off of a Widnows Server 2008 R2 machine.
Build fails with the following error:

Project "Gainput\build\Project.sln" (1) is building "Gainput\build\lib\gainput.vcxproj.metaproj" (9) on node 1 (default targets).
Project "Gainput\build\lib\gainput.vcxproj.metaproj" (9) is building "Gainput\build\lib\gainput.vcxproj" (10) on node 1 (default targets).
PrepareForBuild:
Creating directory "gainput.dir\Debug".
InitializeBuildStatus:
Creating "gainput.dir\Debug\gainput.unsuccessfulbuild" because "AlwaysCreate" was specified.
CustomBuild:
Building Custom Rule gainput/lib/CMakeLists.txt
CMake does not need to re-run because Gainput\build\lib\CMakeFiles\generate.stamp is up-to-date.
ClCompile:
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\bin\CL.exe /c /I"C:/Jenkins_Jobs/workspace/Gainput-Win/gainput-upstream/lib/include" /Zi /nologo /W3 /WX- /Od /Ob0 /Oy- /D WIN32 /D _WINDOWS /D _DEBUG /D GAINPUT_LIB_DYNAMIC=1 /D "CMAKE_INTDIR="Debug"" /D gainput_EXPORTS /D _WINDLL /D _MBCS /Gm- /EHsc /RTC1 /MDd /GS /fp:precise /Zc:wchar_t /Zc:forScope /GR /Fo"gainput.dir\Debug\" /Fd"gainput.dir\Debug\vc100.pdb" /Gd /TP /analyze- /errorReport:queue ....\lib\source\gainput\builtin\GainputInputDeviceBuiltIn.cpp ....\lib\source\gainput\dev\GainputDev.cpp ....\lib\source\gainput\dev\GainputMemoryStream.cpp ....\lib\source\gainput\dev\GainputNetAddress.cpp ....\lib\source\gainput\dev\GainputNetConnection.cpp ....\lib\source\gainput\dev\GainputNetListener.cpp ....\lib\source\gainput\gainput.cpp ....\lib\source\gainput\GainputAllocator.cpp ....\lib\source\gainput\GainputInputDeltaState.cpp ....\lib\source\gainput\GainputInputDevice.cpp ....\lib\source\gainput\GainputInputManager.cpp ....\lib\source\gainput\GainputInputMap.cpp ....\lib\source\gainput\GainputInputState.cpp ....\lib\source\gainput\GainputMapFilters.cpp ....\lib\source\gainput\gestures\GainputButtonStickGesture.cpp ....\lib\source\gainput\gestures\GainputDoubleClickGesture.cpp ....\lib\source\gainput\gestures\GainputHoldGesture.cpp ....\lib\source\gainput\gestures\GainputPinchGesture.cpp ....\lib\source\gainput\gestures\GainputRotateGesture.cpp ....\lib\source\gainput\gestures\GainputSimultaneouslyDownGesture.cpp ....\lib\source\gainput\gestures\GainputTapGesture.cpp ....\lib\source\gainput\keyboard\GainputInputDeviceKeyboard.cpp ....\lib\source\gainput\keyboard\GainputInputDeviceKeyboardMac.cpp ....\lib\source\gainput\mouse\GainputInputDeviceMouse.cpp ....\lib\source\gainput\pad\GainputInputDevicePad.cpp ....\lib\source\gainput\pad\GainputInputDevicePadMac.cpp ....\lib\source\gainput\recorder\GainputInputPlayer.cpp ....\lib\source\gainput\recorder\GainputInputRecorder.cpp ....\lib\source\gainput\recorder\GainputInputRecording.cpp ....\lib\source\gainput\touch\GainputInputDeviceTouch.cpp
GainputInputDeviceBuiltIn.cpp
....\lib\source\gainput\builtin\GainputInputDeviceBuiltIn.cpp(118): warning C4996: 'strncpy': This function or variable may be unsafe. Consider using strncpy_s instead. To disable deprecation, use _CRT_SECURE_NO_WARNINGS. See online help for details. [Gainput\build\lib\gainput.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\string.h(188) : see declaration of 'strncpy'
GainputDev.cpp
GainputMemoryStream.cpp
GainputNetAddress.cpp
GainputNetConnection.cpp
GainputNetListener.cpp
gainput.cpp
GainputAllocator.cpp
GainputInputDeltaState.cpp
GainputInputDevice.cpp
GainputInputManager.cpp
GainputInputMap.cpp
....\lib\source\gainput\GainputInputMap.cpp(64): warning C4996: 'strcpy': This function or variable may be unsafe. Consider using strcpy_s instead. To disable deprecation, use _CRT_SECURE_NO_WARNINGS. See online help for details. [Gainput\build\lib\gainput.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\string.h(105) : see declaration of 'strcpy'
GainputInputState.cpp
GainputMapFilters.cpp
GainputButtonStickGesture.cpp
GainputDoubleClickGesture.cpp
GainputHoldGesture.cpp
GainputPinchGesture.cpp
GainputRotateGesture.cpp
GainputSimultaneouslyDownGesture.cpp
Generating Code...
Compiling...
GainputTapGesture.cpp
GainputInputDeviceKeyboard.cpp
....\lib\source\gainput\keyboard\GainputInputDeviceKeyboard.cpp(137): warning C4996: 'strncpy': This function or variable may be unsafe. Consider using strncpy_s instead. To disable deprecation, use _CRT_SECURE_NO_WARNINGS. See online help for details. [Gainput\build\lib\gainput.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\string.h(188) : see declaration of 'strncpy'
GainputInputDeviceKeyboardMac.cpp
GainputInputDeviceMouse.cpp
....\lib\source\gainput\mouse\GainputInputDeviceMouse.cpp(121): warning C4996: 'strncpy': This function or variable may be unsafe. Consider using strncpy_s instead. To disable deprecation, use _CRT_SECURE_NO_WARNINGS. See online help for details. [Gainput\build\lib\gainput.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\string.h(188) : see declaration of 'strncpy'
GainputInputDevicePad.cpp
....\lib\source\gainput\pad\GainputInputDevicePad.cpp(231): warning C4996: 'strncpy': This function or variable may be unsafe. Consider using strncpy_s instead. To disable deprecation, use _CRT_SECURE_NO_WARNINGS. See online help for details. [Gainput\build\lib\gainput.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\string.h(188) : see declaration of 'strncpy'
GainputInputDevicePadMac.cpp
GainputInputPlayer.cpp
GainputInputRecorder.cpp
GainputInputRecording.cpp
GainputInputDeviceTouch.cpp
....\lib\source\gainput\touch\GainputInputDeviceTouch.cpp(106): warning C4996: 'strncpy': This function or variable may be unsafe. Consider using strncpy_s instead. To disable deprecation, use _CRT_SECURE_NO_WARNINGS. See online help for details. [Gainput\build\lib\gainput.vcxproj]
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\include\string.h(188) : see declaration of 'strncpy'
Generating Code...
ManifestResourceCompile:
C:\Program Files (x86)\Microsoft SDKs\Windows\v7.0A\bin\rc.exe /nologo /fo"gainput.dir\Debug\gainput.dll.embed.manifest.res" gainput.dir\Debug\gainput_manifest.rc
Link:
C:\Program Files (x86)\Microsoft Visual Studio 10.0\VC\bin\link.exe /ERRORREPORT:QUEUE /OUT:"Gainput\build\lib\Debug\gainput.dll" /INCREMENTAL /NOLOGO kernel32.lib user32.lib gdi32.lib winspool.lib shell32.lib ole32.lib oleaut32.lib uuid.lib comdlg32.lib advapi32.lib Xinput9_1_0.lib ws2_32.lib /MANIFEST /ManifestFile:"gainput.dir\Debug\gainput.dll.intermediate.manifest" /MANIFESTUAC:"level='asInvoker' uiAccess='false'" /DEBUG /PDB:"C:/Jenkins_Jobs/workspace/Gainput-Win/gainput-upstream/build/lib/Debug/gainput.pdb" /SUBSYSTEM:CONSOLE /TLBID:1 /DYNAMICBASE /NXCOMPAT /IMPLIB:"C:/Jenkins_Jobs/workspace/Gainput-Win/gainput-upstream/build/lib/Debug/gainput.lib" /MACHINE:X86 /DLL gainput.dir\Debug\gainput.dll.embed.manifest.res
gainput.dir\Debug\GainputInputDeviceBuiltIn.obj
gainput.dir\Debug\GainputDev.obj
gainput.dir\Debug\GainputMemoryStream.obj
gainput.dir\Debug\GainputNetAddress.obj
gainput.dir\Debug\GainputNetConnection.obj
gainput.dir\Debug\GainputNetListener.obj
gainput.dir\Debug\gainput.obj
gainput.dir\Debug\GainputAllocator.obj
gainput.dir\Debug\GainputInputDeltaState.obj
gainput.dir\Debug\GainputInputDevice.obj
gainput.dir\Debug\GainputInputManager.obj
gainput.dir\Debug\GainputInputMap.obj
gainput.dir\Debug\GainputInputState.obj
gainput.dir\Debug\GainputMapFilters.obj
gainput.dir\Debug\GainputButtonStickGesture.obj
gainput.dir\Debug\GainputDoubleClickGesture.obj
gainput.dir\Debug\GainputHoldGesture.obj
gainput.dir\Debug\GainputPinchGesture.obj
gainput.dir\Debug\GainputRotateGesture.obj
gainput.dir\Debug\GainputSimultaneouslyDownGesture.obj
gainput.dir\Debug\GainputTapGesture.obj
gainput.dir\Debug\GainputInputDeviceKeyboard.obj
gainput.dir\Debug\GainputInputDeviceKeyboardMac.obj
gainput.dir\Debug\GainputInputDeviceMouse.obj
gainput.dir\Debug\GainputInputDevicePad.obj
gainput.dir\Debug\GainputInputDevicePadMac.obj
gainput.dir\Debug\GainputInputPlayer.obj
gainput.dir\Debug\GainputInputRecorder.obj
gainput.dir\Debug\GainputInputRecording.obj
gainput.dir\Debug\GainputInputDeviceTouch.obj  /machine:X86 /debug
LINK : fatal error LNK1104: cannot open file 'Xinput9_1_0.lib' [gainput\build\lib\gainput.vcxproj]
Done Building Project "Gainput\build\lib\gainput.vcxproj" (default targets) -- FAILED.

Xinput 9.1.0 and lastest Windows SDK installed.
Xinput9_1_0.lib appears to be installed normally as part of windows 7 is this just a limitation of the platform?  is that exact version of xinput required or can it be another?

I think basically any version of Xinput would suffice. The issue here is that the library was changed at some point from "Xinput9_1_0" to just "xinput". As you're using a not so common Windows version, it's picking up the wrong library.
Take a look at CMakeLists.txt, there is a case for Windows where it sets XINPUT to one of the mentioned library names depending on the system version. You should be able to fix by tweaking the version comparison.
Does that help?


The Plugin loads on Paper 1.20.1 but nothing happens

I can load the Plugin on my Paper 1.20.1 Server with no problems [CNPC] Enabling CustomNPCs v1.3
but after typing as an admin:
/customnpcs:npc create test
or
/customnpcs:npc help
nothing happens

Try typing /npc create

This issue was fixed in #11
Thanks for reporting it!


Allow import filters to reference already imported data

When importing data it would be neat to reference already imported data in the filter. For example: "import only new events that have an ip address that falls into a subnet included in that column".
Could this be implemented efficiently?
Our current workaround is to export the data for the filter in a script and use it to create an import filter.

I'm not sure if I have understood the full picture. Is the premise that events that have been previously imported are imported again? Based on your example, it sounds like the events may not exactly be the same (e.g., varying timestamp) but a subset of them overlaps with existing data. Deduplication, essentially. Did I get this right?
More broadly, it sounds like you would like to have dynamic import filters. This is certainly something we need to revisit, because a static expression is quite limited in a continuously changing environment.

Could this be implemented efficiently?

Any solution that would tie the import to archive and index would not perform with high data rates.
One thought that came to mind immediately in this regard is the use of Bloom filters for set membership tests. Except it's the inverse problem: we want to tolerate false negatives but not false positives. The dual to a Bloom filter is some form of (direct-mapped) cache, which often comes in the form of a hash table. That would be possible to implement efficiently, but assumes locality in the data input, which may not be the case for IP addresses all over the world. The implication would be that some data would get duplicated, but not the subset absorbed by the cache.
Another efficient approach could be pruning: first insert everything, including duplicates, and then remove redundant entries later, in a second pass. But there's currently no machinery in place for deletion. It would probably be easy to add (just another bitmap to mark deleted event IDs), but it's not immediately clear to me how to find a feasible solution to the uniqueness problem, especially for large domains like IPv6 addresses.

I'm not sure if I have understood the full picture. Is the premise that events that have been previously imported are imported again? Based on your example, it sounds like the events may not exactly be the same (e.g., varying timestamp) but a subset of them overlaps with existing data. Deduplication, essentially. Did I get this right?

No, not exactly. Its not about importing duplicated data, but related data. For example one set of logs might include subnets while another (different) one contains ip addresses. After having imported the logs that include subnets, you might only want to import events from the second set of logs that contains IP addresses that are included in a subnet you imported previously.

Any solution that would tie the import to archive and index would not perform with high data rates.

Yeah, that is what I am afraid of. Not sure if you could buffer data to continuously speed this up ...

It would probably be easy to add (just another bitmap to mark deleted event IDs), [...]

That might prevent VAST from returning deleted events, but doesn't memory management over time. (And possible data regulation laws?)

For example one set of logs might include subnets while another (different) one contains ip addresses. After having imported the logs that include subnets, you might only want to import events from the second set of logs that contains IP addresses that are included in a subnet you imported previously.

Got it, so it's in fact some custom, cross-correlating logic. I'm afraid this is something that will not be easy to support in full generality (At least not at import time).
Upleveling, I wonder what generic primitives are enough to express a meaningful set of such constraints. A a separate filtering component could maintain some constant-space state (e.g., a list of mergeable subnets in a ring buffer) and then perform some computation with it. But that's pretty low-level.

That might prevent VAST from returning deleted events, but doesn't memory management over time. > (And possible data regulation laws?)

Yeah, aging out old data is the next big thing we need to tackle for operational settings!

Got it, so it's in fact some custom, cross-correlating logic. I'm afraid this is something that will not be easy to support in full generality (At least not at import time).

I thought so. The operations would be pretty complex and time consuming.

I'm closing this one for now because there's no clear path forward on creating a feature that's not a one-off.


Create app.json

app.json not needed. You can deploy in heroku. No app.json in this repository So all developers can learn about direct deploy on heroku.


Example not working

When I run the example, I can see that webpack built the bundle. If I fix the typo in index.html ("Tpe something in here to prove state isn't lost") and save the file, I can see that webpack rebuilt the bundle, but the website doesn't update until I manually reload.

I met the same problem. Do you solve it?


Issue cross compiling from mac to windows (mingw32)

If I cross compile to windows from my mac with:
cd demo; cargo build -vvvv --target x86_64-pc-windows-gnu
then when running up on windows I get the error "libstdc++-6.dll not found". I believe this is solvable by getting rustc to use -static -static-libstdc++ -static-libgcc but I can't see how that is possible.
Would be good to know if there is any solution for this that you are aware of, or if not any plans for the future that may resolve the issue.

Worth noting, just tried this on linux too (again cross compiling to windows) same issue.

The cc crate passes CXXFLAGS through to the C++ compiler so you could try using CXXFLAGS='-static -static-libstdc++ -static-libgcc' cargo build -vvvv --target x86_64-pc-windows-gnu.

Hi, sorry for the delay in responding. I tried this but it doesn't help. The problem is that this applies to the compilation phase but not to the linking phase. The linking is done through rustc (I'm using a cxx-build build script), and I can't find a way of forcing that to use static libstdc++.

Ok, I've made progress. Added the following to my build.rs:
let target: &str = &std::env::var("TARGET").unwrap();
if target.ends_with("-pc-windows-gnu") {
    println!("cargo:rustc-link-lib=static:+whole-archive,+bundle=stdc++");
    println!("cargo:rustc-link-lib=static:+whole-archive,+bundle=pthread.dll");
}

This got a static link with stdc++, and also mean the only dll I had to copy across was libpthread.dll. Still can't get static compilation of libpthread working, but it feels that is more of a mingw issue than anything else.

If there's still guidance needed to get this working, please take this question to any of the resources shown in https://www.rust-lang.org/community.