Configure auto scaling groups

#106 may be relevant here. This explains ASG and how they work in the context of k8s clusters and AZs.
https://aws.amazon.com/blogs/containers/amazon-eks-cluster-multi-zone-auto-scaling-groups/

The issue is no longer valid as we are now 3rd party hosted.


Assertion failure triggered in runtime/memprof.c

We are seeing a new assertion failure in runtime/memprof.c triggered on trunk.
It is triggered bythread_joingraph:
random seed: 219047107
generated error fail pass / total     time test name

[ ]    0    0    0    0 /  100     0.0s Thread.create/join
[00] file runtime/memprof.c; line 238 ### Assertion failed: (trigger >= state->young_start) && (trigger < state->young_ptr)
File "src/thread/dune", line 6, characters 7-23:
6 |  (name thread_joingraph)
           ^^^^^^^^^^^^^^^^
(cd _build/default/src/thread && ./thread_joingraph.exe --verbose)
Command got signal ABRT.
[ ]    0    0    0    0 /  100     0.0s Thread.create/join (generating)

and by Lin Stack:
random seed: 146276534
generated error fail pass / total     time test name

[ ]    0    0    0    0 / 1000     0.0s Lin Stack test with Domain
[ ]    0    0    0    0 / 1000     0.0s Lin Stack test with Domain (generating)
[✓]    3    0    1    2 / 1000     2.9s Lin Stack test with Domain

[00] file runtime/memprof.c; line 238 ### Assertion failed: (trigger >= state->young_start) && (trigger < state->young_ptr)
File "src/stack/dune", line 4, characters 7-16:
4 |  (name lin_tests)
           ^^^^^^^^^
(cd _build/default/src/stack && ./lin_tests.exe --verbose)
Command got signal ABRT.
[ ]    0    0    0    0 /  250     0.0s Lin Stack test with Thread

After pinging Nick this has quickly been fixed in https://github.com/ocaml/ocaml/pull/12817

Closing as the fix has been merged to trunk and is no longer triggered.


chore: technical debt

Major refactor. Move all consts related to inverters, to their own individual managed classes. This improves the overall readability, as well as making it easier to add new ones.
split out cards to their own classes, for better readability, maintenance, and to reduce IDE memory footprint.

Description
Motivation and Context

Reduces overall code debt

Improves ease of adding new support for inverters.

Improves IDE memory overhead

This will also make it easier to componentize the 2 cards into smaller components going forward, where there is an overlap of HTML logic. Reduction of similar variable names, and refactoring all variable names into a singular coding standard and naming convention.

How has this been tested

Type of change
Please delete options that are not relevant.

[X] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

fixes: #226

Thanks for all the improvements


Change SCons output structure

The PR for #954
Currently:

Changes the output structure to the new one for all builds
Adds aliases for languages to just use their name e.g. scons rust
Searches chapters recursively for source files
Adds aliases for chapters

This seems to work to me. Not one of the people who originally weighed in though

I've tested nested chapters with dummy files and it works as far as I can tell. I've got no idea what will happen if there's a code directory inside another, so we should avoid that (although I don't know how that would happen). This also doesn't replicate the structure inside the individual language directories, so if that matters it will need an SConscript file.


bug in the new one

On line 52 of index.js:
for (var i = 0; i < source.length/4; i += 4) {
If you take the total length of the image data and you step through in increments of 4, then you do not ALSO need to divide the length by four on the bounds check.  choose one of the two techniques. and ensure that your index math when pulling the pixels corresponds.  It would be slightly more performant to not multiply, so I would recommend using i < source.length  and i = i + 4  the would give you only additions load/save and bounds check within the loop.
The effect of this is that you are only looking at the first 1/4 of your image data when you create your points. This would be, roughly, the top 1/4 of the images.
A good test of this would be to use an image which CLEARLY had clustering. For example a flag which has two or three horizontal stripes of different colors should cluster nicely.  However with this bug, the k-means system will have difficultly since most of the colors will be missing.

Thank you for reporting this! I will get to the fix in the next episode of the series. Probably in next couple weeks.

Probably in next couple weeks.

:) fixed today, didn't do the video.


Resource/Views/Layouts/Table : Invalid Arguments Supplied for Foreach()

Describe the bug
A clear and concise description of what the bug is.
To Reproduce
Steps to reproduce the behavior:

You can return an empty collection with array or an object.
Or use some condition like this @if (is_array($rows) || is_object($rows)) outside the foreach

Expected behavior
A clear and concise description of what you expected to happen.
it should return a string like "No Data"
Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

OS: [Ubuntu 20]
Browser [chrome]
Version [22]

Smartphone (please complete the following information):

Device: [e.g. iPhone6]
OS: [e.g. iOS8.1]
Browser [e.g. stock browser, safari]
Version [e.g. 22]

Server (please complete the following information):

Platfrom Version: [e.g. 5.6.3]
Laravel Version: [8.0]
PHP Version:  [7.4]
Database:  [MySql]
Database Version:  [8.0.2]

Additional context
Add any other context about the problem here.
this is detail of error : https://flareapp.io/share/Bm06BQB7?error=Bm06BQB7&owner_token=58NFrUNO3L9vflCrpJGOYlHJA51cPtvx

Hey @syofyanzuhad! I tried to pass as a table value the different types that you specified, an empty array, an empty collection, an object (With enumeration support). And I have no error.  What am I doing wrong?
public function query(): array
{
    return [
        'tableCollect'        => collect(),
        'tableArray'          => [],
        'tableIterableObject' => new Repository([]),
    ];
}

i try use like a tutorial..
maybe you got somethink, after look this :
/home/syofyan/dreamworld/learning/laravel/adminpanel-orchid/app/Orchid/Layouts/PostListLayout.php
<?php

namespace App\Orchid\Layouts;

use Orchid\Screen\Layouts\Table;
use Orchid\Screen\TD;

class PostListLayout extends Table
{
    /**
     * Data source.
     *
     * The name of the key to fetch it from the query.
     * The results of which will be elements of the table.
     *
     * @var string
     */
    protected $target = '';

    /**
     * Get the table cells to be displayed.
     *
     * @return TD[]
     */
    protected function columns(): array
    {
        return [
            TD::make('title', 'Title')
                ->render(function (Post $post) {
                    return Link::make($post->title)
                        ->route('platform.post.edit', $post);
                }),

            TD::make('created_at', 'Created'),
            TD::make('updated_at', 'Last edit'),
        ];
    }

}

/home/syofyan/dreamworld/learning/laravel/adminpanel-orchid/app/Orchid/Screens/PostListScreen.php
<?php

namespace App\Orchid\Screens;

use App\Orchid\Layouts\PostListLayout;
use App\Models\Post;
use Orchid\Screen\Actions\Link;
use Orchid\Screen\Screen;

class PostListScreen extends Screen
{
    /**
     * Display header name.
     *
     * @var string
     */
    public $name = 'Blog post';

    /**
     * Display header description.
     *
     * @var string
     */
    public $description = 'All blog posts';

    /**
     * Query data.
     *
     * @return array
     */
    public function query(): array
    {
        return [
            'posts' => Post::paginate()
        ];
    }

    /**
     * Button commands.
     *
     * @return Link[]
     */
    public function commandBar(): array
    {
        return [
            Link::make('Create new')
                ->icon('pencil')
                ->route('platform.post.edit')
        ];
    }

    /**
     * Views.
     *
     * @return Layout[]
     */
    public function layout(): array
    {
        return [
            PostListLayout::class
        ];
    }
}

You are missing a key:
    /**
     * Data source.
     *
     * The name of the key to fetch it from the query.
     * The results of which will be elements of the table.
     *
     * @var string
     */
    protected $target = '';

On the screen, you are using the posts key. So it should look like this:
protected $target = 'posts';

is this issue fixed? I had a similar problem today and can't seem to find a solution for it.
protected function columns(): array
{
    return [
        TD::make('id', 'ID'),

        TD::make('name', 'Product Category Name')
            ->render(function(ProductCategory $productCategory){
                return Link::make($productCategory->name)
                                ->route('platform.product-category.edit', $productCategory);
            }),
    ];
}

This is the code I wrote while following the documentation.


paired device popup: add space between "device" and dongle id

there's no separation between "successfully paired device" and the dongle id

I can't reproduce this

On mobile


Revert "fix(whalebird): s/x64/amd64/"

Reverts wimpysworld/deb-get#1174

A better combined approach has been provided


Using mysqldump.

Are we still able to use mysqldump under ../amp/app/mysql/bin/mysqldump.exe ?
Dumping out my database with mysqldump -u root --no-data my_db yields this error:

mysqldump: Can't read dir of '/etc/mysql/conf.d/' (Errcode: 2 - No such file or directory)
Fatal error in defaults handling. Program aborted

Cheers.

Yay, I managed to get it working by referencing php.ini through --defaults-file. Note, the precedence of the argument is important. mysqldump.exe --defaults-file=../my.ini -u root my_db.
I can imagine this answer is not just limited to surfstack-wamp ;)

Nice find. I'm sure this will help out others that are using it.


FAU_STG_EXT.1 - Transmission of Audit data

Section 2.1.3 para 36
FAU_STG_EXT.1 discusses transmission of audit data and identifies two modes: real-time or periodic. These modes are not mutually exclusive and could be implemented by the same TOE. Please clarify requirements for such configuration.
Change to:
"The evaluator shall examine the TSS to ensure that it details whether the transmission of audit information to an external IT entity can be done in real-time, periodically, or both. In case the TOE is capable of performing transmission periodically, the evaluator needs to verify that the TSS provides details about what event stimulates the transmission to be made as well as the possible acceptable frequency for the transfer of audit data."
Also Section <IP_ADDRESS> para 40
FAU_STG_EXT.1 Please clarify that each supported mode of transmission must be tested.

Language updated following the suggestion above. Fixed in editorial-SD-110123


xxxx

Motivation:
Explain here the context, and why you're making that change.
What is the problem you're trying to solve.
Modification:
Describe the modifications you've done.
Result:
Fixes #.
If there is no issue then describe the changes introduced by this PR.

Submitted by mistake, I guess.

Submitted by mistake, I guess.
Yes, sorry


Login page

User should be able to login, using his registered details.
Email/username should not be case sensitive.
While saving to database, they should be lowercased.
On login, user details should be stored in session.
Without loggin in, User should not be able to create a task

Implemented


Fix markdown issues in README.md

This resolves all issues raised by markdownlint except line length.
See https://github.com/markdownlint/markdownlint/blob/master/docs/RULES.md

Pull Request Test Coverage Report for Build b76a451ea9f079d3befab2bca2e90f3e938015e2-PR-9

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 96.633%

Totals

Change from base Build f2e67018f2d3c09b9db9c67df2035993dddfb160:
0.0%

Covered Lines:
775

Relevant Lines:
802

💛  - Coveralls

Thank you. But, I have deliberately omitted the sh on ``` because in the output is some Elixir code and highlighting becomes a little bit confusing with the sh flag.

I see. I've reverted the changes.


Making RP names show up instead of Steam names

Why does this use steam names instead of RP names

I never much cared for RP names. It shouldn't be too difficult to add yourself or find someone who is willing to. Check out client/hud.lua for name drawing.

Duplicate of #42


Conversion of NCX toc navPoints to  produces different structure

I would appear as though addNavPointElements() in package_document.js is producing output that doesn't match the structure of the original navPoints.
For example:
<navPoint>
    <navLabel></navLabel>
    <content></content>
    <navPoint></navPoint>
    <navPoint></navPoint>
    ...etc.
</navPoint>

becomes:

        ...etc.

Unless there's something of which I'm not aware, shouldn't it instead be:

        ...etc.

The offender appears to be here
I'd be happy to submit a pull request if this is a desired change.

Thanks for reporting this! (most of my test ebooks are EPUB3 with HTML5 NavDoc, not NCX)
Would you mind submitting a pull request, please?

Alright, got there, finally.
I also noticed that this line in readium-viewer-js causes the viewer not to consume the resulting dom in a nice way. The last condition (|| $(dom).html()) is dropping the outer
 and sending an orphaned list of <il>s
We'd cribbed that portion of the viewer and were still getting an undesirably rendered toc. Also a bug? (don't want to presume it isn't intended for some reason of which I'm not aware.)

Thank you for the pull request @chine https://github.com/readium/readium-js/pull/98/files
Based on your last comment https://github.com/readium/readium-js/issues/97#issuecomment-93050876 is looks like your proposed bugfix in readium-js would still require further investigation in readium-js-viewer, before we can claim that this TOC issue is completely solved. Right?
Do you have any EPUB2 (NCX) documents to share? (so we can add them to test for regression bugs)

No problem.
Yes, if you consider both working properly in tandem to be 'completely fixed'. As it stands the API of readium-js would appear to be that, for NCX/EPUB2 TOCs, the result if of the form

...
 which the viewer consumes by .html()-ing and throwing an un-wrapped list of list items right to the UI. So, assuming readium-js is in the right to return the result in that form, then the viewer ought not .html() it. At least, that's my assessment based on us having based our code which consumes the TOC on what we saw in the viewer.
Unfortunately the (single) book we have which caused us to notice this is provided by our partners and isn't ours to share. All say what it is though: The Essentials of Computer Organization and Architecture (4th Ed.) from Jones & Bartlett Learning; ISBN 978-1-284-04561-1

I created an EPUB2 sample which demonstrates what @chine  reported.  You can find it here
However, there doesn't seem to be any malfunctioning that I can see.  But if you inspect the DOM, he is correct that the structure is not nested the same way as the original NCX.


Redundancy of "Add New (Product, Service, User, Group, etc.)" and "Add (Service, Product, etc.)"

Ideas to play with before solidifying wording:

Use "Create New (Product, Service, User, Group, etc.)" when generating them from Admin.

or...

Omit the word Add in the Admin. It would then read " + New Product " or " + New Service " and within a Project, it would remain " + Add Product " or  " + Add Service "

I've updated many of the headings to follow the pattern of Action Thing, i.e. Add Product, and Edit Service.
If there exist any that do not fit into this same pattern they need to be updated.

JEL-21


adding phone comparsion to the project

Hi Gil,
I did not do the unit / e2e testing (because my kid didn't gave me the chance of working for more than 10 min in peas)
I hope you'll be satisfied with the result.
I just like to say that I've continued with the code structure already in use.
I would of prefer to write it a little different, using the controllerAs structure.
good night
Gilad Lev-Ari.

Hi Gilad,
I'll go over this as soon as I can. Stav will be in touch with you
Gil

Hi Gilad,
If you had a bit more time, what changes would you like to make to this implementation?

Hi.
I would like to keep all phones as one row (it is a more common and used
way to compare products). Something like a table each category as it's own
row. I would have removed  the deacription from the table and added a read
more link. This link would have opened a floating layer with all the
descriptions each as a paragraph.
The problem with this way, is that either you are limited to a number of
phones, or you need the add a scroll.
I think adding a scroll is the better way. It is because each user have a
different screen width.
On Apr 8, 2015 9:49 AM, "gilelad"<EMAIL_ADDRESS>wrote:

Hi Gilad,
If you had a bit more time, what changes would you like to make to this
implementation?
—
Reply to this email directly or view it on GitHub
https://github.com/gilelad/angular-phonecat/pull/1#issuecomment-90822323
.


[#889] improvement: Modify default value of rss.server.max.concurrency.of.per-partition.write  to 30.

What changes were proposed in this pull request?
Modify default value of rss.server.max.concurrency.of.per-partition.write  to 30.
Why are the changes needed?
For 0.8.0 Release.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
exiting UTs.

Codecov Report

Merging #1037 (a22154b) into master (96eab1c) will increase coverage by 1.17%.
The diff coverage is 100.00%.

@@             Coverage Diff              @@
##             master    #1037      +/-   ##
============================================
+ Coverage     54.32%   55.49%   +1.17%
+ Complexity     2550     2090     -460
============================================
  Files           382      310      -72
  Lines         21737    13921    -7816
  Branches       1803     1255     -548
============================================
- Hits          11808     7726    -4082
+ Misses         9228     5776    -3452
+ Partials        701      419     -282

Files Changed
Coverage Δ

...a/org/apache/uniffle/server/ShuffleServerConf.java
99.43% <100.00%> (ø)

... and 76 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Add all node versions to travis

Add all the existing node versions to the travis build.
Is there any reason why this wasn't done before?
I'm currently working on a full refactor to tackle #142. And for that I'll drop support for 0.12. I think that it's very reasonable since 0.12 is not maintained since 2016

I don't think I'll put more effort in this PR.
I think that there is nothing to loose testing (and raising the issues by failing) in all possible node versions.
If you still prefer to stick with even versions, fell free to close this PR 🙂

I'll probably tweak this, since node 4 is coming to end of life in a few months.


chore(main): release 2.0.0

:robot: I have created a release beep boop
2.0.0 (2023-01-29)
⚠ BREAKING CHANGES

Add Adjunction and Remove Semigroupal from Apply (#49)
Add natural transformations and profunctors (#48)
New higher kinded types system (#46)

Features

Add Adjunction and Remove Semigroupal from Apply (#49) (368ed8f)
Add adjunction for Free (#51) (a8be37d)
Add natural transformations and profunctors (#48) (cfc1652)
Add Seq and FingerTree (#50) (2908578)
New higher kinded types system (#46) (524b5c3)

This PR was generated with Release Please. See documentation.

:robot: Release is at https://github.com/MikuroXina/mini-fn/releases/tag/v2.0.0 :sunflower:


[Script Recorder] Add clear all steps functionality with warning modal

This is a subtask of https://github.com/elastic/synthetics-recorder/issues/54.
User story:
As a user, when creating a script that I'm not happy with, I want a way to start over.
Proposed solution:
Add a button that allows users to remove all the steps they've previously recorded.
This button should trigger a confirmation dialogue as it's permanently destructive.
@liciavale if you have any design input on where this button should live and how it should look a comment with some lofi visualization would be enough to go on.
EDIT:
The scope of this issue has grown considerably. I'm adding this meta list of tasks that can be broken into sub-issues before we can close this.

[ ] Add delete all steps button to enable user to clear previous actions and start again

include modal warning

[ ] Update pause/stop/close/start-over functionality
[ ] Implement dedicated "start" screen
[ ] Implement updated step flow UI

It's likely there's overlap here with existing issues, we have just had numerous discussions on this thread and I wanted to summarize in the description.

I'm going to close this for now as we do have the functionality in the title implemented.
We still want to add a dedicated start screen - we should work on a dedicated ticket to add this, and move as much design work as can be reused for this purpose to that new home. The UI has changed quite a bit since this ticket was created, so we will want to reassess and make a fresh run at this.


Removes all WCCP code and utilities, updates docs

Resolves #9847.

There seem to be some fixes to the autest.sh script that are not directly related to the WCCP removal. Can we do these separately?

It "fixes" the b0rken indentation :).

What was the change to jobs.yaml? The whole file was reformatted and has a large diff.

Because we don't have a standard YAML format :). I fixed it.


Rectify error on IssueLinkFactory.php "RectorPrefix202403\Nette\Utils\Reflection::getUseStatements(): Return value must be of type array, null returned

Ref https://github.com/rectorphp/getrector-com/actions/runs/8338339748/job/22818486985#step:5:13
It seems due to nette/utils 4.0

Reproduced in other project, I created issue

https://github.com/rectorphp/rector/issues/8565

for it.

I created PR

https://github.com/rectorphp/rector-downgrade-php/pull/216

for it.

Re-open as still error.


[help] Form Validation: Multiple dependency input / Array input

How would I validate an array and specify multiple dependency?
For example: if at least on of the inputs has value, make all of them required.
I have a table with 4 inputs on each row. If one of the 4 inputs has a value I need the rest to be required.
My table consists of: Medicine, frequency, # of days, and instructions. So now, it's clear why I need it to be that way. Not only that, it's dynamic also because they can add another row. How do I solve this?

Hi @xxRockOnxx, it’s been a while, have you figured it out?

Uhm, since another old issue was bumped again I already forgot it. Right now I use jquery validator and just made a custom default highlight and unhighlight function that makes it compatible with Semantic UI. I'll try to make a gist of it sometime.


Feature/handler extension

Checklist

[ x] I checked the Contributing Guidelines before creating this request.
[x ] New extensions are written in Swift 5.0.
[x ] New extensions support iOS 10.0+ / tvOS 9.0+ / macOS 10.10+ / watchOS 2.0+, or use @available if not.
[ ] I have added tests for new extensions, and they passed.
[x ] All extensions have a clear comments explaining their functionality, all parameters and return type in English.
[x ] All extensions are declared as public.
[ ] I have added a changelog entry describing my changes.

Hi @canyoldas0, thanks for submitting this PR but I don't think it suits this library, as it's not really an extension on any of the Swift/Apple SDKs.


fuzzy search menu entries

this lets the user search his menu entries
While creating hte PR I've noticed my code is badly formatted: is there a script in the repo to format the code ?

this lets the user search his menu entries
While creating hte PR I've noticed my code is badly formatted: is there a script in the repo to format the code ?

Th for this PR @teto!
I’m not using any formatting automation, I’ll check the code and do testing before I squash/rebase-merge, it would be helpful if you can squash into one single clean commit without the WIP comments and prints, but don’t worry about it too much because I will do it anyway while manually merging the PR.

https://github.com/ibhagwan/fzf-lua/commit/f80437f77aabd3900808995a169d5d4380987f28 - rebased, cleaned up and merged, also added to the README/doc.
Let me know if this works well for you as I don't really use menus.

Note the new name of this provider is menus (and not menu) for consistency with other neovim providers (marks, jumps, etc)

thanks it works !


content-disposition request header is incorrectly handled in nodejs 19.9.0

Reproduction
Steps to reproduce the behavior:
const fetch = require('node-fetch');

fetch(
  'http://localhost:8080',
  {
    method: 'POST',
    headers: {
      'content-length': '0',
      'content-type': 'application/octet',
      'content-disposition': 'attachment; filename="filename.jpg"',
    },
  },
);

The content-disposition header is transmitted empty, thus cause server side parser error.
POST / HTTP/1.1
content-length: 0
content-type: application/octet
content-disposition:
Accept: */*
User-Agent: node-fetch/1.0 (+https://github.com/bitinn/node-fetch)
Accept-Encoding: gzip,deflate
Connection: close
Host: localhost:8080

Expected behavior
Similar nodejs code with http module works as expected:
const http = require('http');

const r = http.request(
  'http://localhost:8080/',
  {
    method: 'POST',
    headers: {
      'content-length': '0',
      'content-type': 'application/octet',
      'content-disposition': 'attachment; filename="filename.jpg"',
    },
  },
);

r.end();

Your Environment

software
version

node-fetch
2.6.9

node
19.9.0

Operating System
linux

Additional context
It works as expected in nodejs 19.7.0.

Fixed by https://github.com/nodejs/node/pull/50977?


rootless: do not block SIGTSTP

we were previously proxying all the signals, but doing that for SIGTSTP prevented the main process to be stopped by the tty.
Closes: https://github.com/containers/libpod/issues/2775

LGTM
@mheon PTAL

Hm. I thought job control used SIGSTOP not SIGTSP. Let me test...

Well, I was clearly wrong. This does work.
LGTM once tests go green.

/lgtm

/retest


Feature Request: Custom Logger Injection Support

Background
Currently, langchain.js directly uses the default console.log and console.error for logging, which means every error is written directly to stdout and stderr, with no built-in way to handle or redirect these logs.
Interestingly, it appears that langchain.py utilises a built-in logger object, which allows developers to inject their own logger, providing a degree of flexibility for various use cases. However, it is worth mentioning that I haven't personally used langchain.py, and if this observation is incorrect, please correct me.
For my use case, I'm deploying applications on Google Cloud Platform's Cloud Run service. This environment encourages structured logging, compatible with GCP's Cloud Logging service. Therefore, having a more flexible logging approach in langchain.js would be highly beneficial.
Proposal
To enhance the flexibility of langchain.js in terms of logging, I propose the following:

Introduce a feature that allows setting a logger that is compatible with JavaScript's built-in console object. The logger should follow a subset of the interface Console as defined in @types/node. The rationale behind using the built-in console object is twofold:

It is standard and familiar to all JavaScript developers.
It parallels langchain.py's usage of the built-in logger, fostering consistency across languages.

Initially, this logger should be global and accessible across the entire codebase. The reasons behind this design choice are:

To avoid large code changes in the existing codebase.
Uncertainty about the necessity of multiple loggers - YAGNI (You Aren't Gonna Need It).

outdated
Here's an example of what the implementation might look like:
// subset of node:console.
interface Logger { /* */ }

let logger: Logger = console

export function setLogger(l: Logger) {
  logger = l
}

export function error(message?: any, ...optionalParams: any[]): void {
  logger.error(message, ...optionalParams)
}

export function clearLogger() {
  logger = console
}

// before
console.error(err)

// after
import * as logger from "langchainjs/util/logger"
logger.error(err)

I believe that this proposal, if approved, would greatly improve the flexibility of langchain.js in terms of logging, especially for those of us deploying applications in environments like GCP's Cloud Run. If this proposal is acceptable to the maintainers, I'd be happy to contribute the changes via a pull request.
Looking forward to your feedback on this proposal!

Comment:
After some further reflection on this feature proposal and the specific requirements of my project, I've realized an important factor that I had initially overlooked.
For my logging needs, I need to include a traceId in each log entry that changes with each request. Since Node.js is designed to handle multiple requests concurrently, this traceId becomes essential for correlating log entries to specific requests.
Given this requirement, it becomes clear that we need to be able to set a different logger for each request. This cannot be achieved with a global logger, as I initially proposed. Instead, we should provide a way to pass the logger through the constructor of the chain.
For instance, something like this:
const chain = new SomeChain({ logger: myLogger /* default console */ })

Then, the given logger can be propagated to sub-components of the chain as necessary. This change would allow us to handle different loggers for different requests, providing a greater level of control over the logging process.
I'm sorry for overlooking this requirement in my original proposal, but I hope we can consider this modification as we continue discussing the proposed feature. I look forward to your thoughts and feedback on this modification.

Upon further exploration, I've discovered that the existing callback mechanisms provided by langchain.js can be effectively used for my logging needs.
Given this, it seems that the feature proposed in this issue might not be necessary after all. Therefore, I am planning to close this issue.
I appreciate the community's time and consideration on this matter.


twr_timer_single_shot fail in async audio lib

Windows 11
Chrome
When running audio tests in async mode, I get the following error with twr_timer_single_shot.
I just recently made a change to twr_timer_single_shot to make it isCommonCode.  In addition it is still on my todo list to add test cases for the timer library.  I have never actually tested it! So it is likely that this is a bug in my code.

I fixed this and committed to dev.  You can't use PostEvent with isCommonCode.


Pin java8-multiarch at Forge compatible version

Enhancement Type
Improve an existing feature
Describe the enhancement
As reported here https://github.com/MultiMC/Launcher/issues/4470#issuecomment-1025114255 , Forge doesn't work with Java 8 update 321 or newer.
Should pin the java8-multiarch variant to 8u312-b07-jre

@itzg this can be closed.


[jvm_package] how to set num_workers in estimator API

How can I set num_workers
val model = XGBoost.train(trainRDD, paramMap, numRound, nWorkers = 5, useExternalMemory = true)
when using XGBoostEstimator, xgboosts integration in sparks pipelines.

set nworkers in paramMap

what do you mean by num_workers

https://github.com/dmlc/xgboost/blob/master/doc/parameter.md nthread?

https://github.com/dmlc/xgboost/blob/master/jvm-packages/xgboost4j-example/src/main/scala/ml/dmlc/xgboost4j/scala/example/spark/SparkWithDataFrame.scala
line 28 the number of rabit nodes. At least in the readme examples it is
used explicitly
Nan Zhu<EMAIL_ADDRESS>schrieb am Fr. 30. Dez. 2016 um 01:52:

https://github.com/dmlc/xgboost/blob/master/doc/parameter.md nthread?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/dmlc/xgboost/issues/1917#issuecomment-269716687, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABnc9P5RQfe3Q2moiNDxvK5hXgANlaCQks5rNFXRgaJpZM4LXjMd
.

the number of rabit nodes equals to the number of tasks/partitions of training data, so nWorkers = args(1) does the job

the number of rabit nodes equals to the number of tasks/partitions of training data, so nWorkers = args(1) does the job

So I do not need to configure this property as it should work automatically?
What about node discovery? Do I need to set this somewhere or are these set
up automatically based on spark workers nodes?
Nan Zhu<EMAIL_ADDRESS>schrieb am So. 1. Jan. 2017 um 06:45:

the number of rabit nodes equals to the number of tasks/partitions of
training data, so nWorkers = args(1) does the job
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/dmlc/xgboost/issues/1917#issuecomment-269893014, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABnc9NpT1xqsxdms9ZnRzCksSHghoXH_ks5rNz0pgaJpZM4LXjMd
.

So I do not need to configure this property as it should work automatically?
What about node discovery? Do I need to set this somewhere or are these set
up automatically based on spark workers nodes?
Nan Zhu<EMAIL_ADDRESS>schrieb am So. 1. Jan. 2017 um 06:45:

the number of rabit nodes equals to the number of tasks/partitions of
training data, so nWorkers = args(1) does the job
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/dmlc/xgboost/issues/1917#issuecomment-269893014, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABnc9NpT1xqsxdms9ZnRzCksSHghoXH_ks5rNz0pgaJpZM4LXjMd
.

Set nworkers in paramMap, and the XGBoostEstimator will pick it up.

Set nworkers in paramMap, and the XGBoostEstimator will pick it up.

If you do not set it, it will by default be set to 1.
For some automatic configuration, you can perhaps read the Spark configuration spark.executor.instances, and set nworkers equal to this number.

If you do not set it, it will by default be set to 1.
For some automatic configuration, you can perhaps read the Spark configuration spark.executor.instances, and set nworkers equal to this number.

@geoHeil , you do not need to do that, the magic is in https://github.com/dmlc/xgboost/blob/master/jvm-packages/xgboost4j-spark/src/main/scala/ml/dmlc/xgboost4j/scala/spark/XGBoost.scala#L175. And it is not anything related to worker/executor nodes, it is only related to the expected number of partitions of your training data
worker as the name of configuration entry is kind of confusing, but it is to be consistent within the XGBoost Context
@xydrolase , nworkers is actually the number of partitions, so it shouldn't be anything related to Spark executor

Thanks for this clarification.

@CodingCat Sure, there is no direct connection between executor number and nworkers, and I reckon that.
I normally set up the distributed training by allocating multiple cores to an executor, and avoid having multiple tasks under the same executor, so that an executor can use all the cores of a specific node in the cluster, and runs only one task. The idea is to reduce the number of partitions, so that there are less synchronization between Rabit workers, which seem to cause slowdowns.


Performance tests for the invocation loop

Expected behavior
N/A
Actual behavior
N/A
Steps to reproduce
N/A
If possible, minimal yet complete reproducer code (or URL to code)
No response
What version of this project (swift-aws-lambda-runtime) are you using?
N/A
Swift version
N/A
Amazon Linux 2 docker image version
No response

Implement a test for https://maxday.github.io/lambda-perf/
and contact the owner to add the runtime 2 to the list of bench

local performance with swift-benchmark package


Improvement: onAir -> Enable

What this PR does:
Which issue(s) this PR fixes:

Fixes #
Special notes for your reviewer:
OnAir 一词无法望文生义，现在直接改造成 Enable。

Codecov Report

Merging #243 (1fc8b0c) into develop (8b17845) will not change coverage.
The diff coverage is 0.00%.

@@           Coverage Diff            @@
##           develop     #243   +/-   ##
========================================
  Coverage    40.93%   40.93%
========================================
  Files           51       51
  Lines         2587     2587
========================================
  Hits          1059     1059
  Misses        1415     1415
  Partials       113      113

Impacted Files
Coverage Δ

pkg/filter/ratelimit/mock.go
0.00% <0.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 8b17845...1fc8b0c. Read the comment docs.


Unable to use both AlignAssignmentStatement and UseConsistentWhitespace rules

Hi,
It seems like it is not possible to use both AlignAssignmentStatement and UseConsistentWhitespace rules because the first contradicts the second. UseConsistentWhitespace is enforcing that only one space is used before the operator while AlignAssignmentStatement assert that all "=" operators are aligned. The only way the analyzer would not fail is that all the keys from the hashtable are the same length ;)
To reproduce:

Create a script with the following code:

$hashtable = @{
    property1       = "value"
    anotherProperty = "another value"
}

Run the analyzer with code formatting settings:

Invoke-ScriptAnalyzer -Path MyScript.ps1 -Settings CodeFormatting

You should see a PSUseConsistentWhitespace rule warning
No warning should be the expected result

PSUseConsistentWhitespace rule is more general in the sense that it takes into account any binary operator, including the assignment operator.
AlignAssignmentStatement specifically targets property value pairs in a hashtable.

You're right that the results they produce can be contradictory when dealing with property value pairs in a hashtable and that can be confusing. However, their original goal was to be used in succession - first UseConsistentWhitespace then AlignAssignmentStatement - in the formatting tool used in the powershell extension in vscode. Looking back, it probably would've been more prudent to just have an alignment switch in UseConsistentWhitespace rule that would functionally be equivalent to the AlignAssignmentStatement rule.
However, given the current state I think it is best to ignore one of the rule or disable either AlignAssignmentStatement rule or UseConsistentWhitespace.CheckOperator switch.

Going forward, when we get a chance we can probably deprecate the AlignAssignmentRule and add an equivalent switch in the UseConsistentWhitespace rule.
@daviwil thoughts?

Yep, it would be a cleaner approach to use a single rule for that.  Sometimes we don't know until we get there :)

This is quite ridiculous.  https://github.com/PowerShell/PSScriptAnalyzer/blob/master/Engine/Settings/CodeFormatting.psd1 defines both as enabled.
How can the supposed default style definition of PSSA have incompatible styles in it, over 1.5 after it was reported as not working.   Is PSSA not dogfooding its own default style?  The code in https://github.com/PowerShell/PSScriptAnalyzer/blob/master/Engine/Settings/CodeFormatting.psd1 fails when trying to format it with the "CodeFormatting" style, afaic.
https://github.com/PowerShell/PSScriptAnalyzer/blob/master/Engine/Settings/CodeFormattingOTBS.psd1 has this highly ironic snippet
        PSUseConsistentWhitespace  = @{
            Enable         = $true
            CheckInnerBrace = $true
            CheckOpenBrace = $true
            CheckOpenParen = $true
            CheckOperator  = $true
            CheckPipe       = $true
            CheckSeparator = $true
}

Is nobody else using this style definitions?  They seem to be documentation of rules according to outside pre-existing definitions and are not rules which are actually possible with the software, and are actually tested to work as a style definition (as opposed to unit tests of each piece in isolation of the others).  Are any of the coding styles actually usable?
CodeFormattingStroustrup and CodeFormattingAllman both also use CheckOperator = $true and CheckHashtable = $true.
It seems like the quick "fix" is to admit reality, and disable CheckOperator in all of those styles until such time as it can be implemented in a way that respects the settings of AlignAssignmentStatement.


⚠ Panoramas has degraded performance

In e16b0e7, Panoramas ($SITE_URL_PANORAMAS) experienced degraded performance:

HTTP code: 200
Response time: 3677 ms

Resolved: Panoramas performance has improved in 640f9aa after 9 minutes.


[Ticketing Epic] Implement Ticketing Management

Introduction
Manages ticket sales and reservations.
Stories to be implemented

[ ] User can purchase or book a ticket.
[ ] Retrieves the list of tickets
[ ] When a ticket is paid it changes the status of the payment from PENDING to OK. The date of the purchase will be useful if we want to CANCEL the purchase.

Stores nice to have

Steps

I have written down some use stores as an example, feel free to change them. @anyulled

Splitting the database maybe could be done in another task ;) up to you


Migrate to MacOS Catalina

Closes #1529
Closes #1572
Closes https://github.com/camunda/camunda-modeler/issues/1584

Temporarily set to build only and run all the tests on MacOS.

The actual publishing jobs are available here: https://travis-ci.org/camunda/camunda-modeler/builds/611909768
Tested on both MacOS Mojave (10.14.6) and MacOS Catalina (10.15.1).
Notarized build is available as nightly.

npm run build and starting the App work absolutely fine on my Mac! (Version 10.15.1)

Works on Arch Linux, too.

@philippfromme Can you quick check if the distribution still works on Windows, too?

Works on Windows 👏


Server output/console spam "Compressing structure-cache and pre-generator data"

"Compressing structure-cache and pre-generator data" is spammed so hard on my server I cannot read any other output.

Is there a way to disable this message
Why is it spamming the console so hard?
What other info can I provide to be more helpful?

I have the same problem. OTG v8.3, Forge <IP_ADDRESS>47
The 7th value in Biome Bundle/OpenTerrainGenerator/PregeneratedChunks.txt seems to be increasing rapidly, maybe related to this

I found a way to hide the message from logs: set LogLevel: Quiet in mods/OpenTerrainGenerator/OTG.ini. The source of the log spam doesn't seem to cause any other negative effects like high CPU usage, so just hiding the logs is probably good enough.

Hey @AnsuzThurisaz , thanks for reporting this. Not sure why it would do that, can you see anything else happening at the same time, like the server saving? If this keeps happening, you can send me your world if that's manageable.

Hello, i have same issue righr now, i loaded 100 chunks and since then the console wont stop spaming "Compressing structure cache and pre generator data" and "Removed 0 cached chunks"
As you asked, the server isn't saving anything, i could try to send you the world but it's on a modpack i have made personally so idk if this would work

I also have this issue, I tried to pre-gen 10 chunks as a test and its spamming me hard now.

I resolved the issue by deleting all the files except "config.yaml" from "Minecraft\Biome Bundle\OpenTerrainGenerator"

@csweet89 does this delete anything or break the generation or something ?

Just deleting PregeneratedChunks.txt seems to be enough (the file with the rapidly increasing value I mentioned). The file was automatically recreated with some default values and nothing seems broken

I can confirm this works, i'll check if there's any problem with the map/generation and if there's one i'll comment again. Thanks btw.

Hey guys, deleting the config.yaml or PregeneratedChunks.txt may cause issues with the pregenerator and BO4 structure generation (which you're likely not using), so ofcourse isn't prefered. I have not been able to reproduce this, so wonder if this only occurs with certain modpacks. To anyone that has this problem:

Is it reproducible every time you create a new world and pregenerate?
If so, does it still happen when not using other mods (only OTG)?
If so, can you figure out which mod combination is causing the problem?


Add a licence

Leafgem does not have a licence in file form yet, it would be a good idea to add one.

Licence was added.


Add "Inherit documentation" code fix for missing documentation

Fixes #968

:+1:

Implements the  part of #764
(added the comment for traceability)


requireNativeComponent: "RNSVGLinearGradient" was not found in the UI manager

where I have to add this linear gradient dependency?

resolved by installing pods in ios


Mazumder - Implement DB changed (applies to Argos and GlyGen)

Sub-tickets will be made in this ticket for Robel, then converted to issues.
Changes noted and approved HERE

Per Meeting on 2/24:

Use MockUps from a few months ago to update the selected search criteria for Robel's tickets
Use BCOs and data body to selecting searches and filtering
Send MockUps to @jeet-vora for review and input by COB Tuesday Feb 28th
Present MockUps to Robel in the All Hands meeting on Friday March 3

Link to Mock ups here: https://docs.google.com/presentation/d/1ddx0OyN7fs-vexixtngCBSbGyz4FfChz/edit?usp=sharing&ouid=101713086141465545921&rtpof=true&sd=true

Hi @rykahsay - Were you able to access the link above and do you need any additional info from me or Raja?

Please have a look at :
https://data.tst.glygen.org/
https://beta-data.glygen.org/

@rykahsay @rajamazumder
Bug comments:

the FAQ and Release History pages do not seem to be functioning in GlyGen Tst/Beta

Argos/GlyGen Applicable comments: I agree with the look, feel, and functionality of the Tst page but have a few recommendations/comments:

Recommendation: I would explain the difference between 'dataset metadata' and 'dataset body' in the FAQs, or information bubbles on the search page

Functionality Issue: When selecting either 'dataset body' or 'dataset metadata' and typing 'sars' in the search box, the same results return for both selections. As a user, I would assume these would return different results, where a) 'dataset body' pulls from the BCO information (i.e. in ARGOS =  species, priority, tag, file name, status, scope, and molecule) and it would give you a list of BCOs that fall into that search category (current search return view). Where as b) 'dataset metadata' would primarily return a list of datasets that the search criteria were present in, maybe even with the potential of selecting the line(s) of data in the datasets in the Sample View. Essentially, I'm not sure I fully understand how or how well the 'dataset metadata' filter is functioning, or even how best to test this. Maybe it would help to discuss this part in more depth.

Recommendation: rather than have a link that says 'view details...' in the search list, I would make either the BCO or the dataset file selectable from the search page. Where as the 'view details' selection could lead you to the information compiled under 'Release History' and/or 'History Detail' per that BCO/dataset

Recommendation: Have BCOs show up consecutively in the list on the search page

Request: I like the link to the API page - Requesting to have this added to the ARGOS page

Request: The ability to Archive certain datasets/Cards/BCOs and have a) this to be reflected in the Release History and, b) be able to access Archived datasets/Cards/BCOs in the DB via a tab

Comments after meeting on 5/17
Bugs:

[ ] When selecting filters in the side bar, the numbers reflected in each category do not adjust to the currently available selection based on the current filters being applied
Example: after selecting Datasets Body, searching 'Kinase' in the search bar, and selecting Homo sapiens in the filters (which shows a list of 48 files), other #'s next to the filtering options did not adjust to the current search criteria. For example,  the # of CSVs or Reviewed datasets remains the same and out numbers the list of 48 files

[ ] search bar does return results for a specific BCO name or BCO file name under either choice of Dataset Body/Dataset Metadata
Example: BCO name: Human O-GlcNAc Glycosylation Citations (O-GlcNAc Atlas); File Name:human_proteoform_citations_glycosylation_sites_oglcnac_atlas.csv

[ ] No option to return to a previous page:

[ ] Cannot easily reset filters. No 'Reset All', 'Remove All', or 'Apply All' function

[ ] Recommendation: I would explain the difference between 'dataset metadata' and 'dataset body' in the FAQs, or information bubbles on the search page

@jeet-vora Please add your bugs/comments

@steph-sing I have merged my comments and issue with your comments above. We now have all the issues reported in the comment that we discussed yesterday.

Thank you @jeet-vora - We can present/discuss during the Friday meeting. I will notify Hadley. Thanks

@rykahsay Please take a look at the comments above - https://github.com/FDA-ARGOS/data.argosdb/issues/208#issuecomment-1553342315

@jeet-vora @steph-sing -- having all the issues on one ticket is not easy to track. Please make separate ticket/issue for each of the issues and I can try to address them separately

Sepearate tickets created from the comment. Added @steph-sing to track

#302
#303
#304
#305
#306
#307

broken out into smaller tickets - closing this ticket


python27Packages.pyroute2: 0.5.11 -> 0.5.12

Semi-automatic update generated by nixpkgs-update tools. This update was made based on information from https://repology.org/metapackage/python2.7-pyroute2/versions.
meta.description for python27Packages.pyroute2 is: "Python Netlink library"
meta.homepage for python27Packages.pyroute2 is: "https://github.com/svinota/pyroute2"
Updates performed

Version update

To inspect upstream changes
Impact

Checks done (click to expand)

built on NixOS

Warning: a test defined in passthru.tests did not pass

0 of 0 passed binary check by having a zero exit code.

0 of 0 passed binary check by having the new version present in output.

found 0.5.12 with grep in /nix/store/49v5w1v89jmjmkr9268di65ckrhd9dqa-python2.7-pyroute2-0.5.12

directory tree listing: https://gist.github.com/a0d8cfebaa47d3010db26452718861af

du listing: https://gist.github.com/58270151b44fc90526a1ea192878b8d5

Rebuild report (if merged into master) (click to expand)

15 total rebuild path(s)

4 package rebuild(s)

4 x86_64-linux rebuild(s)
4 i686-linux rebuild(s)
3 x86_64-darwin rebuild(s)
4 aarch64-linux rebuild(s)

First fifty rebuilds by attrpath
pulseaudio-dlna
python27Packages.pyroute2
python37Packages.pyroute2
python38Packages.pyroute2

Instructions to test this update (click to expand)

Either download from Cachix:
nix-store -r /nix/store/49v5w1v89jmjmkr9268di65ckrhd9dqa-python2.7-pyroute2-0.5.12 \
  --option binary-caches 'https://cache.nixos.org/ https://r-ryantm.cachix.org/' \
  --option trusted-public-keys '
  r-ryantm.cachix.org-1:gkUbLkouDAyvBdpBX0JOdIiD2/DP1ldF3Z3Y6Gqcc4c=
  cache.nixos.org-1:6NCHdD59X431o0gWypbMrAURkbJ16ZPMQFGspcDShjY=
  '

(r-ryantm's Cachix cache is only trusted for this store-path realization.)
For the Cachix download to work, your user must be in the trusted-users list or you can use sudo since root is effectively trusted.
Or, build yourself:
nix-build -A python27Packages.pyroute2 https://github.com/r-ryantm/nixpkgs/archive/9e0ab6dcb3a8ef4c57043785e290c4ecb4b6d9f0.tar.gz

After you've downloaded or built it, look at the files and if there are any, run the binaries:
ls -la /nix/store/49v5w1v89jmjmkr9268di65ckrhd9dqa-python2.7-pyroute2-0.5.12
ls -la /nix/store/49v5w1v89jmjmkr9268di65ckrhd9dqa-python2.7-pyroute2-0.5.12/bin

Pre-merge build results
We have automatically built all packages that will get rebuilt due to
this change.
This gives evidence on whether the upgrade will break dependent packages.
Note sometimes packages show up as failed to build independent of the
change, simply because they are already broken on the target branch.
Result of nixpkgs-review 1

4 packages built:
- pulseaudio-dlna
- python27Packages.pyroute2
- python37Packages.pyroute2
- python38Packages.pyroute2

Maintainer pings
cc @mic92 for testing.

Result of nixpkgs-review pr 87384 1

4 packages built:
- pulseaudio-dlna
- python27Packages.pyroute2
- python37Packages.pyroute2
- python38Packages.pyroute2


Metron-2053: Refactor metron-enrichment to decouple Storm dependencies

Contributor Comments
https://issues.apache.org/jira/browse/METRON-2053
Getting this up for code review. Functional testing still underway.
The rationale for this work is to decouple the platform from Storm dependencies and enable us to integrate with other streaming frameworks. Of particular interest is Spark, but I'll save the meat of that conversation for a proper DISCUSS thread.
Test script pending.
Pull Request Checklist
Thank you for submitting a contribution to Apache Metron.
Please refer to our Development Guidelines for the complete guide to follow for contributions.
Please refer also to our Build Verification Guidelines for complete smoke testing guides.
In order to streamline the review of the contribution we ask you follow these guidelines and ask you to double check the following:
For all changes:

[x] Is there a JIRA ticket associated with this PR? If not one needs to be created at Metron Jira.
[x] Does your PR title start with METRON-XXXX where XXXX is the JIRA number you are trying to resolve? Pay particular attention to the hyphen "-" character.
[x] Has your PR been rebased against the latest commit within the target branch (typically master)?

For code changes:

[x] Have you included steps to reproduce the behavior or problem that is being changed or addressed?

[ ] Have you included steps or a guide to how the change may be verified and tested manually?

[ ] Have you ensured that the full suite of tests and checks have been executed in the root metron folder via:
mvn -q clean integration-test install && dev-utilities/build-utils/verify_licenses.sh

[ ] Have you written or updated unit tests and or integration tests to verify your changes?

[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?

[ ] Have you verified the basic functionality of the build by building and running locally with Vagrant full-dev environment or the equivalent?

For documentation related changes:

[ ] Have you ensured that format looks appropriate for the output in which it is rendered by building and verifying the site-book? If not then run the following commands and the verify changes via site-book/target/site/index.html:
cd site-book
mvn site

Note:
Please ensure that once the PR is submitted, you check travis-ci for build issues and submit an update to your PR as soon as possible.
It is also recommended that travis-ci is set up for your personal repository such that your branches are built there before submitting a pull request.

Testing Plan
Setup Test Environment

Build full dev metron/metron-deployment/development/centos6$ vagrant up
Login to full dev ssh root@node1, password "vagrant"
Set some environment variables - Note: set your metron version accordingly if using this test script in the future for a later version.

# version info
export METRON_VERSION=0.7.1
export SOLR_VERSION=6.6.2

# paths
export METRON_HOME=/usr/metron/${METRON_VERSION}
export HDP_HOME=/usr/hdp/current
export KAFKA_HOME=/usr/hdp/current/kafka-broker
export SOLR_HOME=/var/solr/solr-${SOLR_VERSION}
export ELASTIC_HOME=/usr/share/elasticsearch
export KIBANA_HOME=/usr/share/kibana
export STORM_LOGS=/var/log/storm/workers-artifacts

# host info
export METRON_HOST=node1
export ZOOKEEPER=${METRON_HOST}:2181
export BROKERLIST=${METRON_HOST}:6667
export STORM_UI=http://${METRON_HOST}:8744
export ELASTIC=http://${METRON_HOST}:9200
export ES_HOST=http://${METRON_HOST}:9200
export KIBANA=http://${METRON_HOST}:5000

Basics
Verify data is flowing through the system, from parsing to indexing

Open Ambari and navigate to the Metron service http://node1:8080/#/main/services/METRON/summary
Open the Alerts UI

Verify alerts show up in the main UI - click the search icon (you may need to wait a moment for them to appear)

Head back to Ambari and select the Kibana service http://node1:8080/#/main/services/KIBANA/summary
Open the Kibana dashboard via the "Metron UI" option in the quick links

Verify the dashboard is populating

Profiler
Verify profiler still works in Storm and the REPL.
Pulled from https://github.com/apache/metron/blob/master/metron-analytics/metron-profiler-storm/README.md

First, we'll configure the profiler to emit a profile every 1 minute rather than every 15, for expediency:

First, stop the profiler
In Ambari, set the profiler period duration to 1 minute via the Profiler config section.

Pull down latest global config to the local file system
$METRON_HOME/bin/zk_load_configs.sh -m PULL -o ${METRON_HOME}/config/zookeeper -z $ZOOKEEPER -f
Adjust $METRON_HOME/config/zookeeper/global.json to adjust the capture duration:"profiler.client.period.duration" : "1",
"profiler.client.period.duration.units" : "MINUTES"

Push the changes back up to Zookeeper
$METRON_HOME/bin/zk_load_configs.sh -m PUSH -i $METRON_HOME/config/zookeeper/ -z $ZOOKEEPER

Start the Stellar Shell with the -z command line argument so that a connection to Zookeeper is established.  This is required when  deploying a new profile definition as shown in the steps below.
[root@node1 ~]# source /etc/default/metron
[root@node1 ~]# $METRON_HOME/bin/stellar -z $ZOOKEEPER
Stellar, Go!
[Stellar]>>>

If you haven't already, define your profile.
[Stellar]>>> conf := SHELL_EDIT()
[Stellar]>>> conf
{
  "profiles": [
    {
      "profile": "hello-world",
      "onlyif":  "exists(ip_src_addr)",
      "foreach": "ip_src_addr",
      "init":    { "count": "0" },
      "update":  { "count": "count + 1" },
      "result":  "count"
    }
  ]
}

Check what is already deployed.
Pushing a new profile configuration is destructive.  It will overwrite any existing configuration.  Check what you have out there.  Manually merge the existing configuration with your new profile definition.
[Stellar]>>> existing := CONFIG_GET("PROFILER")

Deploy your profile.  This will push the configuration to to the live, actively running Profiler topology.  This will overwrite any existing profile definitions.
[Stellar]>>> CONFIG_PUT("PROFILER", conf)

Exit the Stellar REPL and now restart the profiler

Make sure the sensor stubs are running.
service sensor-stubs start

Wait a few minutes - we want to wait some multiple of the period duration to ensure that the profiler has been able to flush data to HBase multiple times before we check in the next step.

Check the profiler is writing to HBase
echo "count 'profiler'" | hbase shell
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version <IP_ADDRESS>.6.5.1050-37, r897822d4dd5956ca186974c10382e9094683fa29, Tue Dec 11 02:04:10 UTC 2018

count 'profiler'
24 row(s) in 0.9550 seconds

Start the Stellar REPL back up again
[root@node1 ~]# $METRON_HOME/bin/stellar -z $ZOOKEEPER
Stellar, Go!
[Stellar]>>>

Read values from the profiler. We'll first print out the help on PROFILE_GET and PROFILE_FIXED for context. The ip_src_addr I'm using below, "<IP_ADDRESS>," is pulled from one of the records in the alerts UI.
[Stellar]>>> ?PROFILE_GET
PROFILE_GET
Description: Retrieves a series of values from a stored profile.

Arguments:
    profile - The name of the profile.
    entity - The name of the entity.
    periods - The list of profile periods to fetch. Use PROFILE_WINDOW or PROFILE_FIXED.
    groups - Optional - The groups to retrieve. Must correspond to the 'groupBy' list used during profile creation. Defaults to an empty list, meaning no groups.
    config_overrides - Optional - Map (in curly braces) of name:value pairs, each overriding the global config parameter of the same name. Default is the empty Map, meaning no overrides.

Returns: The selected profile measurements.

[Stellar]>>> ?PROFILE_FIXED
PROFILE_FIXED
Description: The profiler periods associated with a fixed lookback starting from now.

Arguments:
    durationAgo - How long ago should values be retrieved from?
    units - The units of 'durationAgo'.
    config_overrides - Optional - Map (in curly braces) of name:value pairs, each overriding the global config parameter of the same name. Default is the empty Map, meaning no overrides.

Returns: The selected profile measurement periods.  These are ProfilePeriod objects.

[Stellar]>>> PROFILE_GET("hello-world","<IP_ADDRESS>",PROFILE_FIXED(30, "MINUTES"))
[158, 191, 184, 205, 178, 194, 180]

You should see an array of the profile measurements, as indicated in the command output above.

PCAP
Steps adapted from https://github.com/apache/metron/pull/1157#issuecomment-412972370
Get PCAP data into Metron:

Install and setup pycapa (this has been updated in master recently) - https://github.com/apache/metron/blob/master/metron-sensors/pycapa/README.md#centos-6
(if using singlenode vagrant) Kill the enrichment, profiler, indexing, and sensor topologies via for i in bro enrichment random_access_indexing batch_indexing yaf snort;do storm kill $i;done
Start the pcap topology via $METRON_HOME/bin/start_pcap_topology.sh
Start the pycapa packet capture producer on eth1 via /usr/bin/pycapa --producer --topic pcap -i eth1 -k node1:6667
Watch the topology in the Storm UI and kill the packet capture utility from before, when the number of packets ingested is over 3k.
Ensure that at at least 3 files exist on HDFS by running hadoop fs -ls /apps/metron/pcap
Choose a file (denoted by $FILE) and dump a few of the contents using the pcap_inspector utility via $METRON_HOME//bin/pcap_inspector.sh -i $FILE -n 5
Choose one of the lines and note the protocol.
Note that when you run the commands below, the resulting file will be placed in the execution directory where you kicked off the job from.

Run a fixed filter query

Run a fixed filter query by executing the following command with the values noted above (match your start_time format to the date format provided - default is to use millis since epoch)
$METRON_HOME/bin/pcap_query.sh fixed -st <start_time> -df "yyyyMMdd" -p <protocol_num> -rpf 500
Verify the MR job finishes successfully. Upon completion, you should see multiple files named with relatively current datestamps in your current directory, e.g. pcap-data-20160617160549737+0000.pcap
Copy the files to your local machine and verify you can them it in Wireshark. I chose a middle file and the last file. The middle file should have 500 records (per the records_per_file option), and the last one will likely have a number of records <= 500.

Flatfile loader
Make sure no classpath issues have broken it.
Steps adapted from  https://github.com/apache/metron/pull/432#issuecomment-276733075
Preliminaries

Download the alexa 1m dataset:

wget http://s3.amazonaws.com/alexa-static/top-1m.csv.zip
unzip top-1m.csv.zip

Stage import file

head -n 10000 top-1m.csv > top-10k.csv

Create an extractor.json for the CSV data by editing extractor.json and pasting in these contents:

{
  "config" : {
    "columns" : {
       "domain" : 1,
       "rank" : 0
                }
    ,"indicator_column" : "domain"
    ,"type" : "alexa"
    ,"separator" : ","
             },
  "extractor" : "CSV"
}

The extractor.json will get used by flatfile_loader.sh in the next step
Import from HDFS via MR
# truncate hbase
echo "truncate 'enrichment'" | hbase shell
# import data into hbase
$METRON_HOME/bin/flatfile_loader.sh -i /tmp/top-10k.csv -t enrichment -c t -e ./extractor.json -m MR
# count data written and verify it's 10k
echo "count 'enrichment'" | hbase shell

I ran through the full test script provided above and everything works as expected.
Things to note

I notice a few instances where there are SLF4J logger warnings in the REST logs and from the REPL on startup. I'm unsure whether these are new or not.
Using zk_load_configs.sh seems to dump a whole lot of logging detail to the CLI - I'm not sure if this is intentional or not, but I'm not a fan of having this be the default.
I need to refactor the enrichment documentation just a touch - most of it belongs with metron-enrichment-storm, but some config related documentation can probably live in the root metron-enrichment module.

The SLF4J logger warnings in REST are preexisting to this PR.

@nickwallen I believe I've addressed all of your comments so far. I also finished refactoring the enrichment documentation.

+1 Looks good.  I ran through all the test scenarios and did not encounter any problems.


renaming variable: from nbpml to nbl

answering this
git grep nbpml returns nothing

@btrb after the latest merge (#931) there is now a small conflict that needs to be fixed. Could you take a look? thanks

Small comment, but would say "number of boundary layer" not sponge so that we don't have to change everything again if we add different type of boundary method (we actually already have two, sponge and diffusion mask )

@btrb reminder (conflicts)

i think i might have messed the history line with rebase again. the PR is clean and good, but let me know if i should close it and redoit without the rebased commits showing up.

made some cleaning. uncertain if that's better suited yet thou. please let me know if it's ok. otherwise i will just close it and reopen. thanks

Still some stuff from other PRs in it

thank you. i suspected something were not right. i will still have to learn how to do a rebase properly. nevertheless, plz let me close this in favor of nbpml_to_nbl4


Object? instead of dynamic for AuthStore

When working with Dart using Object? instead of dynamic leads to a better API since the Model can be null.

Sounds good! Glad it is on the radar 👍🏼


Trial to get UI test in full screen vscode instance

Signed-off-by: Ondrej Dockal<EMAIL_ADDRESS>

Thanks for the help.


finish renaming sink to view

Another pass through the compiler to replace instances of 'sink' with 'view' as appropriate.
Details in the specific commits.
Closes #24
Note that outrigger will need to be updated once this merges.

@dmajda @bkutil @mstemm

These changes look fine but I think @dmajda/@bkutil should also take a look.
My grep for sink is still finding lots of instances, but it looks like those are for the base class and as a result are appropriate.

Yep. As far as I can tell all remaining instances of sink are proper.
-m

On Jan 5, 2016, at 5:24 PM, Mark Stemm<EMAIL_ADDRESS>wrote:
These changes look fine but I think @dmajda/@bkutil should also take a look.
My grep for sink is still finding lots of instances, but it looks like those are for the base class and as a result are appropriate.
—
Reply to this email directly or view it on GitHub.

Grepping revealed there is a sinks variable in build.js which looks unused. I’m fine with both removing it now or later (together with flattening the object returned from the builder function so that there is no graph property).

I think this comment should be updated too.

Hmm, this comment is no longer true (will fix separately).

Other than this, I think all remaining uses of “sink” are legit. There is a couple of pieces of Juttle code like ... | view sink1 in the tests, which I think could be changed too, but not necessarily. Similarly with few “sink” instances here.
+1

OK, I fixed small semi-related issues separately.


Enhancement: Specify listUrl when creating a new list

When creating a list using spo list add, you can only influence it's URL by the title option.
I'd like to specify my own URL though:

Option
Description

-u, --url
Specify the web relative URL the list should have.

Examples
Create a new list with the title Some list and the url lists/some-list.
m365 spo list add --webUrl "https://contoso.sharepoint.com/sites/project-x" --baseTemplate GenericList --title "Some list" --url
"Lists/some-list"

Looks good to me 👍
Could you also put the API request in your spec? This way it will be easier for whoever picks up this issue, else he/she has to research everything again.

for me you can drop the /Lists/ prefix, so just specify --url some-list

Well, I'd still like the freedom of picking either /Lists/some-list or just some-list. Both can be created, which is why I made it web relative.
Regarding the other point: that's okay, I'll look into it.

@martinlingstuyl is there anything more we need to recheck here before we open this up?

Yeah, I'd need to check the actual requests to update the specs.
I'm the meantime, are there any additional opinions on this @pnp/cli-for-microsoft-365-maintainers?

We should extend the spec to indicate if the --url option is required. Also, we already use the -u short on --webUrl, so can't use it here. While it would make sense to be assigned to --url, we can do that only in v7.

Hi people, I've just looked into it. The command currently uses the REST Api with SP.List. This class does not have a URL member. The ListCreationInformation class does have the member, but this can't be used together with the newer REST Api as far as I know.
We'd have to rebuild the entire command using an older endpoint if we'd like to support it.
I'm doubting if that's worth the effort. What about you, @pnp/cli-for-microsoft-365-maintainers ?

First and foremost, if we're to rebuild the command using the new API, can we guarantee backwards compatibility or would there be breaking changes? If the latter, we'll delay it until v7 anyway, which could mean that between now add the capabilities will changes and deciding now would be less relevant.


Twitter and Google Photos

As for now, it seems ShareX uploads picture embedded into a Tweet or photos from Google Photos as .txt
Example: https://twitter.com/nywolforg/status/1351940301703753728
Result: https://i.neus.xyz/v0OTHz.txt
I took a short look into the php files, and when I change
    if (!isset($extension) || $extension === null || $extension === '') {
        $extension = 'txt';
    }

Now, the URL for the images on Twitter are:
https://pbs.twimg.com/media/EsMOiQbXcAE-g5w?format=jpg&name=small
and logically the scripts uploads it as .txt as there is no extension.
Now, I just thought, maybe a simple URL if check would solve this, but does the script get the URL from ShareX, or just a file from ShareX?

The server doesn't support uploading an image via URL. It's designed to handle file uploads.
ShareX is just sending the server text, which is interpreted as a text file upload.

The server doesn't support uploading an image via URL. It's designed to handle file uploads.
ShareX is just sending the server text, which is interpreted as a text file upload.


Provide an alternative for users without Flash

I think that users who visit sites that use ZeroClipboard are left behind.
Perhaps ZeroClipboard should detect if Flash is available before anything else. If the user-agent doesn't, ZeroClipboard should do something similar to what https://goo.gl does—select the text that needs copying, then prompting the user to copy it themselves, like so:
.

ZeroClipboard prides itself on leaving the UI up to the consumer, so I definitely do not plan to integrate such a thing.  It would already be fairly easy to do with yourself by adding handlers for the various "error" events that ZeroClipboard emits.
That said, I think your point is also strong enough that it warrants perhaps a more useful event so that consumers don't need to listen to and distinguish between all of the various "error" events.  For example, perhaps an event named "fallback"?

Related to my comment: twbs/bootstrap#16269

I agree with @JamesMGreene, in a lot of use cases it would be really nice to have a fallback event.
For example if we want to hide or disable the copy button we have an event handler to do so.

Related: #356

"for example if we want to hide or disable the copy button we have an event handler to do so."
@tarebyte, by "we" do you mean the consumer? I would not want a built-in way of hiding or disabling the "Copy" button, however, the consumer doing that is totally fine, IMO.
Also, would a "copy" event still be emitted, even if the user has no Flash?
I think it should, so that if needed the consumer can still implement their own "highlight with instructions" functionality, a la http://goo.gl.

by "we" do you mean the consumer?

Yes the consumer, sorry about the confusion, hiding elements is not the job of zeroclipboard.

While I agree that ZeroClipboard shouldn't alter the UI, I've wasted (again) a good hour trying to figure out why ZC wasn't working in IE. Turns out it wasn't IE's fault; I simply didn't have Flash installed in it!
However, there was no error message in the console whatsoever to help debug this. The code I used is the example from the README. I think one line in the README about the pitfall of Flash not being install would be a great compromise between some fallbacks suggested here and doing absolutely nothing.

Also, how does GitHub do it for gists? https://gist.github.com/jonrohan/81085b119d16cdd7868a shows the copy buttons in IE and FF without Flash, and both work.

I'd imagine a lot of people are ditching flash after these recent security revelations - http://www.theverge.com/2015/7/8/8911077/adobe-flash-hacking-team-vulnerability


utilising pandas.IntervalIndex.get_indexer

Codecov Report

Merging #41 (ea17e70) into master (9b6658c) will decrease coverage by 0.05%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master      #41      +/-   ##
==========================================
- Coverage   97.27%   97.22%   -0.06%
==========================================
  Files          12       12
  Lines         550      540      -10
==========================================
- Hits          535      525      -10
  Misses         15       15

Impacted Files
Coverage Δ

piso/__init__.py
95.00% <ø> (ø)

piso/accessor.py
98.36% <ø> (-0.08%)
:arrow_down:

piso/intervalarray.py
96.45% <ø> (-0.17%)
:arrow_down:

piso/ndframe.py
100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 9b6658c...ea17e70. Read the comment docs.


[fix-#14012] add throwable Converter

Purpose of the pull request
this close:

#14012

Brief change log
add throwable Converter
after change:

Verify this pull request
This change added tests and can be verified as follows:
SensitiveThrowableConverterTest#testPwdLogMsgConverter

@caishunfeng @ruanwenjun @SbloodyS plz run CI

I find that there are many duplicated codes with existed SensitiveDataConverter, can we abstract a class like SensitiveConverter and make code cleaner?
BTW, may i ask can we override convert method to mask throwable logs, either? If we can, this abstract work will be easier.

thanks for you suggestion, I'll fix it later

I think the following files also need to be updated

the logback-spring.xml in dolphinscheduler-worker and dolphinscheduler-standalone-server
the logback.xml in dolphinscheduler-master

Codecov Report

Merging #14018 (b831605) into dev (4545093) will decrease coverage by 0.03%.
The diff coverage is 46.66%.

:exclamation: Current head b831605 differs from pull request most recent head 27d92e9. Consider uploading reports for the commit 27d92e9 to get more accurate results

@@             Coverage Diff              @@
##                dev   #14018      +/-   ##
============================================
- Coverage     38.22%   38.19%   -0.03%
- Complexity     4437     4438       +1
============================================
  Files          1220     1221       +1
  Lines         42698    42638      -60
  Branches       4734     4714      -20
============================================
- Hits          16322    16287      -35
+ Misses        24571    24546      -25
  Partials       1805     1805

Impacted Files
Coverage Δ

...eduler/common/log/SensitiveThrowableConverter.java
46.66% <46.66%> (ø)

... and 65 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

I am +0 to this PR.
If someone needed to mask the sensitive message, they can write their own ThrowableProxyConverter. DS shouldn't need to consider a lot of these features.

I am +0 to this PR. If someone needed to mask the sensitive message, they can write their own ThrowableProxyConverter. DS shouldn't need to consider a lot of these features.

If one wants to hide IP information, SensitiveConverter can only hide the normal output information at this time. When an UnknownHostException is thrown, the IP information cannot be hidden. This is why I implemented ThrowableProxyConverter.

I am +0 to this PR. If someone needed to mask the sensitive message, they can write their own ThrowableProxyConverter. DS shouldn't need to consider a lot of these features.

If one wants to hide IP information, SensitiveConverter can only hide the normal output information at this time. When an UnknownHostException is thrown, the IP information cannot be hidden. This is why I implemented ThrowableProxyConverter.

I mean user can implement their own ThrowableProxyConverter , if someone want to mask username/password/personnumber/ip/publickKey/proxyIp, they will submit a lot of pr to change these...... this is not our core feature.

I am +0 to this PR. If someone needed to mask the sensitive message, they can write their own ThrowableProxyConverter. DS shouldn't need to consider a lot of these features.

If one wants to hide IP information, SensitiveConverter can only hide the normal output information at this time. When an UnknownHostException is thrown, the IP information cannot be hidden. This is why I implemented ThrowableProxyConverter.

I mean user can implement their own ThrowableProxyConverter , if someone want to mask username/password/personnumber/ip/publickKey/proxyIp, they will submit a lot of pr to change these...... this is not our core feature.

I know what you're worried about, so I'm going to make these rules configurable
you can see #13993


Translate squids UIBootgrid

Fixed

no, you need to use formatting: https://docs.phalconphp.com/en/3.0.0/reference/volt.html#filters
something like {{ lang._('Please setup a voucher server first (%sgoto auth servers%s)') | format('','') }}

Done

@fichtner because this is very generic, do you think it is possible to patch bootgrid after loading the script so it applies to all tables?

_lang('') work only in .volt files. In included .js it not work

I know - I am thinking about the base layout file here: https://github.com/opnsense/core/blob/master/src/opnsense/mvc/app/views/layouts/default.volt

If you look at it, you just have to overwrite a property of the library after it is loaded:
https://github.com/opnsense/core/blob/master/src/opnsense/www/js/jquery.bootgrid.js#L1294-L1300

@fichtner I made a replacement for this which works globally.


DBZ-2610 In downstream-only content, add context directory to podman command example

DBZ-2610 notes an error in the installation guide for installing Debezium on OpenShift. This is downstream only content, however the same content is in the user guide for each connector, and we fetch and reuse this upstream content in the downstream user guide.
So this update makes the same edit to the doc for the MongoDB, DB2, PostgreSQL, and SQL Server connectors. I'll do the MySQL update in the open PR for the reunified content.

LGTM, I'm going to go ahead and merge this and note in the DBZ-2610 issue that we're waiting on #1864 that contains the MySQL changes before we can officially resolve that issue.


Add ledger refactoring exercise

Thank you, I'm really looking forward to how this works out on the site.

Very interesting!


RuntimeError: invalid argument 0: Sizes of tensors must match except in dimension 0. Got 722 and 697 in dimension 3 at /opt/conda/conda-bld/pytorch_1579022060824/work/aten/src/TH/generic/THTensor.cpp:612

Hello, thanks for your work.
When I run the 1_train.py ,there are something wrong in 'for batch_idx, (inputs, targets) in enumerate(valid_loader):'.
Could you please tell us what the data format looks like in your a_dataset.
our dataset is 15000   pictures for train,3000 for valid,there are all have 10 catogories.
We are looking forward for your reply!Thank you very much!

Dear CatchBelif,
See the below usage.
[cid:a77a24c2-7071-4a36-80ba-6684290f9fe2]

test directory is optional.

If you have another questions, let me know.
Sincerely,
Yechan Kim

보낸 사람: CatchBeliF<EMAIL_ADDRESS>보낸 날짜: 2020년 9월 13일 일요일 오후 11:07
받는 사람: unique-chan/Complement-Cross-Entropy<EMAIL_ADDRESS>참조: Subscribed<EMAIL_ADDRESS>제목: [unique-chan/Complement-Cross-Entropy] RuntimeError: invalid argument 0: Sizes of tensors must match except in dimension 0. Got 722 and 697 in dimension 3 at /opt/conda/conda-bld/pytorch_1579022060824/work/aten/src/TH/generic/THTensor.cpp:612 (#1)
Hello, thanks for your work.
When I run the 1_train.py ,there are something wrong in 'for batch_idx, (inputs, targets) in enumerate(valid_loader):'.
Could you please tell us what the data format looks like in your a_dataset.
our dataset is 15000 pictures for train,3000 for valid,there are all have 10 catogories.
We are looking forward for your reply!Thank you very much!
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com/unique-chan/Complement-Cross-Entropy/issues/1, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AOY27DSYNBORWZ4DDHS542TSFTG3XANCNFSM4RKVY3CA.


Adding more fields to Artifact

The newly added fields should be useful for identifying a desired
Artifact from a list of Artifact objects.
Signed-off-by: Hoa Nguyen<EMAIL_ADDRESS>

Do you think that using Enum's (instead of str) for gem5 versions to avoid variations of a single type (like "v20-1" and "v20.1" for gem5 20.1)?
Also, should the benchmark name be part of the Artifact?

Version shouldn't be an enum. We don't want to have to update it on every update to gem5.
I'd vote against benchmark for all artifacts.
However, it may be nice to be able extend an artifact with specific fields. There's no reason we can't do that with json/mongo/etc. Maybe we should also allow **kwargs and have a dictionary with "extra" fields that we save to the database/json/etc.

I opted to flatten the Artifact.extra to Artifact fields (i.e. Artifact.extra_field_1, Artifact.extra_field_2, etc.)

Though, I have no reason other than we won't need to re-flatten the "extra" field again while querying for artifacts

Ah, I just remember why I checked the keywords. There are fields in data that are not part of the function arguments (i.e. "hash"). So I'd prefer to check the keywords before adding to the data dictionary, or have the extra field being a dictionary.


auto_select_target is not a part of Shatur/neovim-cmake

The function auto_select_target does not exist in neovim-cmake, at least not in the latest commit, where did it come from?
The plugin doesn't work because of that.

Thanks @DiGMi for testing this, it's based on https://github.com/JafarAbdi/neovim-cmake/tree/pr-auto_select_target, I forgot to open a PR upstream, I'll do it later tomorrow


Feature/setup python

Closes: #1

Codecov Report

:exclamation: No coverage uploaded for pull request base (main@36bae69). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff            @@
##             main        #9   +/-   ##
========================================
  Coverage        ?   100.00%
========================================
  Files           ?         1
  Lines           ?        12
  Branches        ?         0
========================================
  Hits            ?        12
  Misses          ?         0
  Partials        ?         0

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 36bae69...e4ed6fd. Read the comment docs.


Enable the GitHub merge queue

@s3bk: The context of this change is that we are going to be gradually disabling bors for the servo organization, since merge queue support is built into GitHub now. In order to merge changes, you can now click the "merge when ready" button and this will do what bors did in the past. We've set the commit style to "squash and merge" in order to have a linear commit history on servo organization repositories, but if you have a preference this can also be adjusted in the branch protection settings in GitHub. Please reach out if you have any questions or concerns.

@mrobinson Unfortunately I am no longer a maintainer, so I can't merge this. (I don't know why).

@s3bk You should have write access to this repository now, which should allow you to merge changes here via the merge queue.

Thanks. It is good to see that I am not the only one who wants to keep pathfinder alive.

Thanks for the review!


Skip perfmon test on windows pyside2 CI

Description
Skip the perfmon test on windows with pyside2 on CI.
Supersedes #2221

Ok, this has been all green twice @tlambert03 - rerunning a third time, hopefully will be all green too, and then we're back!!

3 out of 3!

great sleuthing!  with that narrowed down, I'm wondering if the stuff I struggled with in deleting the PySide2 app is behind this.  PySide bug was reported and in progress here: https://bugreports.qt.io/browse/PYSIDE-1470


Feature request: Add a substitution variable for the current git repository

The equivalent of:
$(git rev-parse --show-toplevel 2>/dev/null)
would be really useful...

Where would you use it in?

In the browse and include paths used by the cpp plugin - assuming it would be available...

OK, wouldn't the current workspace path be enough for you?

No - unfortunately our code base is large, so I have multiple workspaces within the same repo. The browse and includes paths have several entries which are outside the workspace, but within the git repo. Relative paths don't always work, but some workspaces are at different levels within the repo. The repo can also be checked out in any other folder. So the one thing that is consistent between them all is the root of the repository.

Also want this feature. I want to set environment variable for launch.json and tasks.json to match the current branch name

@joaomoreno Isn't this already be a variable in vscode?
https://github.com/Microsoft/vscode/blob/eac49a321b84cb9828430e9dcd3f34243a3480f7/extensions/git/src/statusbar.ts#L36
Can we access it in variable substitution?

@joaomoreno, I'm second to @Thaina question. Maybe $(git-branch) can be accessed via ${command:CommandID} syntax?

@Thaina You can actually do this for the tasks.json file. You can add
            "options": {
                "env": {
                    "WHATEVER": "VALUE"
                }
            }

The cool thing I found out today is that you can do something like:
"GIT_BRANCH":"echo `git rev-parse --abbrev-ref HEAD`"

which will set $GIT_BRANCH to your current branch, which can be accessed using ${GIT_BRANCH} in the command...

@Gruntfuggly I suspect that it only be accessed in command which will execute that. If I access environment variable directly in the code would it be the branch name or that git command text?

@Thaina I currently do:
           "command": ". ${WORKSPACE}/env.sh; qmake <etc.> ; make <etc.> \"",
            "options": {
                "env": {
                    "WORKSPACE": "`echo $(git rev-parse --show-toplevel 2>/dev/null)`"
                }
            },

Which finds the root folder of the git repo and exectutes the env.sh script in the right place, but also the qmake has access to the WORKSPACE variable and is used to pull in other files.
I've realised I put the quotes in the wrong place in my first example (fixed now).

I have found that vscode can make variable substitution with command
https://code.visualstudio.com/docs/editor/variables-reference#_settings-and-command-variables
Do we have git command that return branch?

@joaomoreno Really, can we have a command that just return that $(git-branch) variable?

Since you can have multiple git repositories open, what would you expect in that case?

@joaomoreno It should be the git repo of the project itself when it running or debugging

We can implement it as a command. But commands don't have any context...

@joaomoreno OK but then what would happen in this line of code?
https://github.com/Microsoft/vscode/blob/eac49a321b84cb9828430e9dcd3f34243a3480f7/extensions/git/src/statusbar.ts#L36

That is an icon.

Still not possible?


Suggestion: Then? Why not With?

Nice idea!
I personally suggest a different keyword: .with { ... }
UILabel().with {
    $0.textColor = .blackColor()
}

Makes a bit more sense.
The keword/idea reminds me a bit of the old VB's With...End With statement: https://msdn.microsoft.com/en-us/library/wc500chb.aspx

Hi @mattijsf!
Why I choose then instead of with is to avoid name conflicts. Because with() is more general than then(). That means, other frameworks might have with() already.

Okay! Sounds like you already gave it a thought :)

Okay! Sounds like you already gave it a thought :)


Updated run-docker.sh to include values needed for verification

Updates the run-docker.sh script to add the environment variables needed for running verification on the finn-examples model builds. These variables are passed into the Docker container to allow the build script to find the files needed for verification.
The corresponding finn-examples PR can be found here: https://github.com/Xilinx/finn-examples/pull/100

Looks good to me!


Migrate integration test case for Pulsar sink.

Is your feature request related to a problem?

Migrate all kafka supported integration test cases for pulsar sink.

[x] canal_json_basic
[x] autorandom
[x] batch_add_table
[x] big_txn
[x] capture_session_done_during_task
[ ]  cdc  fails
[x] cdc_server_tips
[x] changefeed_auto_stop
[x] changefeed_error
[x] changefeed_finish
[x] changefeed_pause_resume
[x]  changefeed_reconstruct
[x]  charset_gbk
[x]  cli
[ ]  clustered_index
[ ]  common_1      fails
[x]  ddl_attributes
[x]  ddl_manager
[x]   ddl_only_block_related_table
[x]  ddl_puller_lag
[x]  ddl_sequence
[ ]  default_value fail
[x]  drop_many_tables
[x]  event_filter
[x]  force_replica_table
[x]  foreign_key
[x]  gc_safe_point
[ ]  generate_column fail
[x]  kv_client_stream_reconnect
[ ]  many_pk_or_uk fails
[x]  move_table
[x]  multi_capture
[ ]  multi_rocks fail
[ ]  multi_source  fail
[ ]  multi_table_ddl
[ ] multi_table_ddl_v2
[ ]  multi_topic
[ ]  multi_topic_v2
[ ]  new_ci_collation fail
[x]  owner_resign
[x]  partition_table
[x]  processor_err_chan
[x]  processor_etcd_worker_delay
[x]  processor_resolved_ts_fallback
[x]  processor_stop_delay
[x]  region_merge
[x]  resolve_lock
[x]  resource_control
[x]  row_format
[x]  savepoint
[x]  simple
[x]  sink_hang
[x]  sink_retry
[x]  split_region
[ ]  tidb_mysql_test
[ ]  tiflash

Add some new integration test case for pulsar sink.

Describe the feature you'd like
As above.
Describe alternatives you've considered
No response
Teachability, Documentation, Adoption, Migration Strategy
No response

/assign @asddongmen


Buggy connecting

Its not working properly, sometimes it doesn't connect properly to the server and other times, I join and I cant move

Update the launcher.


docs: fix typo and code block

There is a code block under the Adding a fields item correctly section that is displaying as multiple inline blocks on docs.imgix.com. There is a possibility that the markdown parser expects a language declaration here, so adding one should fix this.

@allcontributors add @sherwinski for docs


Make more of the functions in py-dag optionally graph agnostic

Some functions can act on an arbitrary graph, but others do not. This should make it consistent, and is also useful in dagobah job expansion

LGTM


PI-3483 Ensure documentation of ancillary variables handling

Documentation to answer user questions like

"what happens to a cubes ancillary variables when I ..."

A broad variety of solutions is possible

do nothing, allow users to determine by experiment
write general account of strategies (e.g. whitepaper)
document generalised operation on key cube operations (e.g. cube.regrid, cube.collapsed)
document specific behaviours (e.g. on regridding + interpolation scheme classes)

I made a separate ticket, because we are still deferring the choice of whether we "release" ancillary variables in Iris 3.0
So we may want to keep documentation in separate PRs for now, on the launch_ancils feature branch.

Note:
There are virtually no statements anywhere about what happens to cell-measures.
This could be improved at the same time, where appropriate.

Probably to be considered within a broader scope of Iris behaviours

aux-coords, cell-measures + ancils
all of them may be handled differently by different operations

Re-open when needed ?


Update project tag/category

Casper QRCode - Infrastructure --> DApp
CasperSign- infrastructure --> DApp
Covalent- infrastructure --> DApp
FIO- infrastructure -->
Matterfi- infrastructure scalability

Updated Casper QRCode, CasperSign and Covalent. FIO and MatterFi are categorised as DApps as target categorisation was not specified. If this needs changing, a new issue/request will be created to make the necessary changes.


Add PHP 8.0 runtime support

must target 1.x (and 2.x)
related with https://github.com/FriendsOfPHP/PHP-CS-Fixer/pull/5034
release 1.x must be then tagged/released

@SpacePossum LGTM?

This is definitely no-go, how do you ensure it works on PHP 8?

@kubawerlos run phpunit tests locally using php8, see https://github.com/FriendsOfPHP/PHP-CS-Fixer/pull/5034#issuecomment-652646416 why CS fixer should be installable on php8 without extra config needed

I don't want to need to run it locally, that's what CI is for.

I don't want to need to run it locally, that's what CI is for.

I analysed the Travis CI and it is tested with nighty php build, thus php8 already.

Yes, it is tested with --ignore-platform-reqs and is allowed to fail, that's what I was referring in https://github.com/PHP-CS-Fixer/diff/pull/18#issuecomment-652638798.

I know, I reviewed it, but dev requirement to tests this PR are not php8 installable (should be fixed with phpunit release on Aug 7, 2020 - do we need to wait until then?)

Putting PHP8 in composer suggest we support it, we've tested it and are confident the tool will work fine on it.
Looking at PHP8 timetable the official release is at Nov 26, with a lot of RC's before it. As such I would not claim we support it as of yet. It would be great to start and continue testing on the RC's, but for now it is just to early IMHO.

Closing for now to keep focus on bugs and more pressing issues, please comment when PHP 8 RC is out than I'll reopen! :)


Update coverage badge

TODO:

[ ] Unit tests and/or doctests in docstrings
[ ] Tests pass locally
[ ] Docstrings and API docs for any new/modified user-facing classes and functions
[ ] Changes documented in docs/release.rst
[ ] Docs build locally
[ ] GitHub Actions CI passes
[ ] Test coverage to 100% (Coveralls passes)

Looks like it is working! 🎉


Update soiling default?

Current default soiling loss of 5% for PV in SAM seems too high in light of recent studies. More thorough literature review required, but might make sense to decrease the default.

Default in PVWatts is 2%. We need to dig up some papers to support this change. @dguittet

Further literature review does not immediately indicate the need for a changed default value, however, it may be worth revisiting in the future to examine consistencies between loss assumptions in the detailed model and PVWatts. Closing this issue and opening another one indicating that need.


Use nested jars

https://fabricmc.net/wiki/documentation:fabric_loader#nested_jars

A nested JAR must itself also be a mod

Great idea, and I assume this is what Via does. If it prevents dependency conflicts I'm all for it; it'd just require a commit to Geyser's main repository to create a barebones mod.

A nested JAR must itself also be a mod

If you use Loom, it generates mod metadata for you

Example: https://github.com/astei/krypton/blob/master/build.gradle#L31