QueueFake size method returns wrong value

Laravel Version: 5.8.33
PHP Version: 7.1.25
Database Driver & Version: n/a

Description:
QueueFake size returns wrong value
Steps To Reproduce:

Install Laravel by any means
make a new job by running php artisan make:job TestJob
make a new test by running php artisan make:test QueueSizeTest
copy the following test method:

   public function testQueueSize()
    {
        \Queue::fake();

    	$job = new TestJob();

        dispatch($job);
        dispatch($job);
        dispatch($job)->onQueue('Q2');

        $this->assertEquals(2, \Queue::size());
        $this->assertEquals(1, \Queue::size('Q2'));
    }

run the test, it would fail

The flaw is in QueueFake' size method:
    /**
     * Get the size of the queue.
     *
     * @param  string|null  $queue
     * @return int
     */
    public function size($queue = null)
    {
        return count($this->jobs);
    }

it doesn't use $queue parameter at all and it improperly calculates amount of jobs, since
jobs array is associative array, refer to push method:

public function push($job, $data = '', $queue = null)
    {
        $this->jobs[is_object($job) ? get_class($job) : $job][] = [
            'job' => $job,
            'queue' => $queue,
        ];
    }

This indeed appears to be a bug. Thanks for reporting. Appreciating a PR if you could whip one up.

I can't believe how lazy I am, I forgot that I was using a custom QueueFake for years because of this.
This code is just for inspiration, it works in my project but if you base a fix on it, please vet it it works in all cases:
    public function size($queue = null)
    {
        return collect($this->jobs)
            ->map(function (array $job) use ($queue) {
                return $job[0]['queue'] === $queue;
            })
            ->count();
    }

@mfn thanks for the inspiration, but that piece doesn't traverse through properly, I'll implement something soon

PR was merged


Merge remote-tracking branch 'refs/remotes/dzenbot/master'

https://guides.github.com/f
https://github.com/dzenbot/DZNEmptyDataSet/pull/270/commits/10a224bc194c44971f117168ceab5230a54a91f9eatures/mastering-markdown/

ss


Nested :include for to_json

It doesn't appear that the :include option passed to to_json is working with nested representers.
require 'ostruct'
require 'roar/json'
require 'roar/decorator'

class BookRepresenter < Roar::Decorator
  include Roar::JSON

  property :title
  property :author, :class => OpenStruct do
    property :first_name
    property :last_name
  end
end

rp1 = OpenStruct.new(
  :title => 'Ready Player One',
  :author => OpenStruct.new(
    :first_name => 'Ernest',
    :last_name => 'Cline'
  )
)

rp1_representer = BookRepresenter.new(rp1)

# Works for regular fields
rp1_representer.to_json(:include => [:title])
#=> "{\"title\":\"Ready Player One\"}"

# Works for including an entire embedded object
rp1_representer.to_json(:include => {:author => true})
#=> "{\"author\":{\"first_name\":\"Ernest\",\"last_name\":\"Cline\"}}"

# Doesn't work when trying to only include some fields for embedded object
rp1_representer.to_json(:include => {:author => [:first_name]})
#=> "{\"author\":{\"first_name\":\"Ernest\",\"last_name\":\"Cline\"}}"

Am I just doing something wrong here?

Sorry, I meant to also include this example:
rp1_representer.to_json(:include => {:author => {:include => [:first_name]}})
#=> "{\"author\":{\"first_name\":\"Ernest\",\"last_name\":\"Cline\"}}"

as per this SO question/answer: http://stackoverflow.com/questions/4443218/ror-nested-include-to-include-sub-resources-in-to-xml-to-json

Or even this:
rp1_representer.to_json(:include => {:author => {:include => {:first_name => {}}}})
#=> "{\"author\":{\"first_name\":\"Ernest\",\"last_name\":\"Cline\"}}"

Now that's funny because I was thinking about that feature today. Are we twin brothers?

Must be psychically linked!

I'm :psyched:

@doughsay Can you help me with tests? Jump on https://gitter.im/trailblazer/chat !

https://github.com/apotonick/representable/tree/nested-include

Now that is awesome: https://github.com/apotonick/representable/blob/nested-include/test/include_exclude_test.rb#L38 Thanks!!!


Chat Bots

It's not an issue now, but it will become one later. Better early than late!

do you mean chat moderation bots?

no, just spammers
On Thu, Nov 12, 2020 at 2:36 PM sm64js<EMAIL_ADDRESS>wrote:

do you mean chat moderation bots?
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/sm64js/sm64js/issues/115#issuecomment-726327892, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/ANZKSNZK2JBJRSBGEBZGHXTSPRBMRANCNFSM4TREVRFQ
.


add tab back to show what's under info

Jenkins build was failing on checkVizPackages because the required-packages section wasn't technically within info. Adding a tab declared this correctly.
checkVizPackages()
Error in vizPackageStatus() :
  info$required-packages section of viz.yaml cannot be empty

self-merging to get build going


throws custom exception type for request timeouts

The transaction throws a custom exception type for responses that have a non-success status code, which can be handled by callers of the API. With this pull request we also add a custom exception type for request timeouts that might occur.

@simp42 Thanks for filing this PR!
I'm curious, what's the motivation for adding a dedicated exception type here? Do you feel this particular error needs to be handled in a certain way other errors should not be handled? (That is, if we start adding this exception type, should we add more exception types for other error conditions as well?)
I'm not opposed to adding specific exception types, but I'd like to have a better understanding first to see if it's worth the long-term maintenance overhead.
In particular, what exactly constitutes a "timeout" and do we have tests in place to verify each situation? (DNS timeout, socket connection timeout, socket write timeout, socket read timeout, "HTTP timeout", etc.)

The motivation for this pull request was identifying requests that might be retryable. I'm working with a micro service that sometimes reacts slowly and the requests time out. I'm not an expert in this field, but my client has tu use code like this:
if ($throwable instanceof UnresolvableResponseException ||
    $throwable instanceof ResponseException) {
    return !$this->statusCodeIsClientError($throwable->getCode());
}

if ($throwable instanceof \RuntimeException) {
    return strpos($throwable->getMessage(), 'Request timed out') !== false;
}

to figure out if it should retry sending the same request after an appropriate waiting period. We want to retry everything that is not a client error or where we don't know if the request worked because we got a timeout. So for my personal use case any kind of timeout from your list leads to me not knowing the status of the request. I can't predict if other users would have a use case for more fine grained control.
Matching on the text of the exception that is currently send is not the most desirable way to handle this in my opinion.

The motivation for this pull request was identifying requests that might be retryable. I'm working with a micro service that sometimes reacts slowly and the requests time out. I'm not an expert in this field, but my client has tu use code like this:

@simp42 Sounds like a perfectly valid use case 👍 I wonder if introduction a specific TimeoutException would be what's required to solve this. I sounds like there are a number of cases where you would want to trigger a retry that is not caused by a timeout (temporary connectivity issues, HTTP 503 etc.).

In particular, what exactly constitutes a "timeout" and do we have tests in place to verify each situation? (DNS timeout, socket connection timeout, socket write timeout, socket read timeout, "HTTP timeout", etc.)

I still think this is a relevant question that appears to be unanswered at this moment. How do other projects handle this?

I'm closing this for now as it hasn't received any input in a while and I believe this has been answered. If you feel this is still relevant, please come back with more details and we can always reopen this :+1:
Thank you for your effort nonetheless, keep it up! :+1:

In particular, what exactly constitutes a "timeout" and do we have tests in place to verify each situation? (DNS timeout, socket connection timeout, socket write timeout, socket read timeout, "HTTP timeout", etc.)
React\Http\Browser has withTimeout() functionality, so il looks like we know exactly what timeout is. IMO regardless of the use case, when user set up condition for his requests he should get an unambiguous information if condition has not been met.
withTimeout is not the only feature that missing own exception - max redirects limit  or buffer limit also throws native exceptions.
One day someone will change 'Request timed out' message on something else and a lot of integrations will be broken :(

IMHO it makes more sense to swap them all out at once. And make sure we have custom exceptions for the different kind of time outs while we do this.

@wnuQq I agree that error reporting is super important and relying on error messages only is very fragile, so we should definitely improve this for this component! Like mentioned above, this is a much bigger task than only adding a TimeoutException as we'd also have to take other error conditions into account to provide a consistent DX. We'll look into this for a future version, but these discussions and PRs to help with this are always appreciated! :shipit:


Spider should include basic beta data

The spider should be able to include basic meta data like "page info" in the browser.  This will requiring picking of the 'Last-Modified' from the header received from the spidered host.

Added modified to the env passed back to the callback if response.header['last-modified'] is present.


Updated README.md

Updated README.md to match bash requirements as well as shell

Could you add a new section "official team" or something like that, and mention collaborators?

Will do

ReadME updated :D

Approve merge ?


("'Tensor' object has no attribute 'qtype'",).

python app_flux.py --offload --fp8
a lot of these same type error,
.......
While copying the parameter named "double_blocks.15.img_mlp.2.weight", whose dimensions in the model are torch.Size([3072, 12288]) and whose dimensions in the checkpoint are torch.Size([3072, 12288]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.15.txt_mod.lin.weight", whose dimensions in the model are torch.Size([18432, 3072]) and whose dimensions in the checkpoint are torch.Size([18432, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.15.txt_attn.qkv.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.15.txt_attn.proj.weight", whose dimensions in the model are torch.Size([3072, 3072]) and whose dimensions in the checkpoint are torch.Size([3072, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.15.txt_mlp.0.weight", whose dimensions in the model are torch.Size([12288, 3072]) and whose dimensions in the checkpoint are torch.Size([12288, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.15.txt_mlp.2.weight", whose dimensions in the model are torch.Size([3072, 12288]) and whose dimensions in the checkpoint are torch.Size([3072, 12288]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.16.img_mod.lin.weight", whose dimensions in the model are torch.Size([18432, 3072]) and whose dimensions in the checkpoint are torch.Size([18432, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.16.img_attn.qkv.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.16.img_attn.proj.weight", whose dimensions in the model are torch.Size([3072, 3072]) and whose dimensions in the checkpoint are torch.Size([3072, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.16.img_mlp.0.weight", whose dimensions in the model are torch.Size([12288, 3072]) and whose dimensions in the checkpoint are torch.Size([12288, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.16.img_mlp.2.weight", whose dimensions in the model are torch.Size([3072, 12288]) and whose dimensions in the checkpoint are torch.Size([3072, 12288]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.16.txt_mod.lin.weight", whose dimensions in the model are torch.Size([18432, 3072]) and whose dimensions in the checkpoint are torch.Size([18432, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.16.txt_attn.qkv.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.16.txt_attn.proj.weight", whose dimensions in the model are torch.Size([3072, 3072]) and whose dimensions in the checkpoint are torch.Size([3072, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.16.txt_mlp.0.weight", whose dimensions in the model are torch.Size([12288, 3072]) and whose dimensions in the checkpoint are torch.Size([12288, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.16.txt_mlp.2.weight", whose dimensions in the model are torch.Size([3072, 12288]) and whose dimensions in the checkpoint are torch.Size([3072, 12288]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.17.img_mod.lin.weight", whose dimensions in the model are torch.Size([18432, 3072]) and whose dimensions in the checkpoint are torch.Size([18432, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.17.img_attn.qkv.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.17.img_attn.proj.weight", whose dimensions in the model are torch.Size([3072, 3072]) and whose dimensions in the checkpoint are torch.Size([3072, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.17.img_mlp.0.weight", whose dimensions in the model are torch.Size([12288, 3072]) and whose dimensions in the checkpoint are torch.Size([12288, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.17.img_mlp.2.weight", whose dimensions in the model are torch.Size([3072, 12288]) and whose dimensions in the checkpoint are torch.Size([3072, 12288]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.17.txt_mod.lin.weight", whose dimensions in the model are torch.Size([18432, 3072]) and whose dimensions in the checkpoint are torch.Size([18432, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.17.txt_attn.qkv.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.17.txt_attn.proj.weight", whose dimensions in the model are torch.Size([3072, 3072]) and whose dimensions in the checkpoint are torch.Size([3072, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.17.txt_mlp.0.weight", whose dimensions in the model are torch.Size([12288, 3072]) and whose dimensions in the checkpoint are torch.Size([12288, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.17.txt_mlp.2.weight", whose dimensions in the model are torch.Size([3072, 12288]) and whose dimensions in the checkpoint are torch.Size([3072, 12288]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.18.img_mod.lin.weight", whose dimensions in the model are torch.Size([18432, 3072]) and whose dimensions in the checkpoint are torch.Size([18432, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.18.img_attn.qkv.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.18.img_attn.proj.weight", whose dimensions in the model are torch.Size([3072, 3072]) and whose dimensions in the checkpoint are torch.Size([3072, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.18.img_mlp.0.weight", whose dimensions in the model are torch.Size([12288, 3072]) and whose dimensions in the checkpoint are torch.Size([12288, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.18.img_mlp.2.weight", whose dimensions in the model are torch.Size([3072, 12288]) and whose dimensions in the checkpoint are torch.Size([3072, 12288]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.18.txt_mod.lin.weight", whose dimensions in the model are torch.Size([18432, 3072]) and whose dimensions in the checkpoint are torch.Size([18432, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.18.txt_attn.qkv.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.18.txt_attn.proj.weight", whose dimensions in the model are torch.Size([3072, 3072]) and whose dimensions in the checkpoint are torch.Size([3072, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.18.txt_mlp.0.weight", whose dimensions in the model are torch.Size([12288, 3072]) and whose dimensions in the checkpoint are torch.Size([12288, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "double_blocks.18.txt_mlp.2.weight", whose dimensions in the model are torch.Size([3072, 12288]) and whose dimensions in the checkpoint are torch.Size([3072, 12288]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.0.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.0.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.0.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.1.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.1.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.1.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.2.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.2.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.2.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.3.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.3.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.3.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.4.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.4.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.4.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.5.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.5.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.5.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.6.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.6.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.6.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.7.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.7.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.7.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.8.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.8.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.8.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.9.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.9.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.9.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.10.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.10.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.10.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.11.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.11.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.11.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.12.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.12.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.12.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.13.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.13.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.13.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.14.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.14.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.14.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.15.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.15.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.15.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.16.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.16.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.16.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.17.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.17.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.17.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.18.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.18.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.18.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.19.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.19.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.19.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.20.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.20.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.20.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.21.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.21.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.21.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.22.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.22.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.22.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.23.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.23.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.23.modulation.lin.weight", whose dimensions in the model are torch.Size([9216, 3072]) and whose dimensions in the checkpoint are torch.Size([9216, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.24.linear1.weight", whose dimensions in the model are torch.Size([21504, 3072]) and whose dimensions in the checkpoint are torch.Size([21504, 3072]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
While copying the parameter named "single_blocks.24.linear2.weight", whose dimensions in the model are torch.Size([3072, 15360]) and whose dimensions in the checkpoint are torch.Size([3072, 15360]), an exception occurred : ("'Tensor' object has no attribute 'qtype'",).
.......

Solved by using XLabs-AI--flux-dev-fp8. I wanted to reuse some other existing fp8 weight, it doesn't work.
But another issue, how to save and load the quantized result into disk cache or something? The requantizatio take around 2~3min which is a long wait.


DIGITS5/Torch/Ubuntu 14.04

I am trying to do a text classification using DIGITS5 and Torch.  Base platform is Ubuntu 14.04.
The DIGITS interface threw the following error:
/usr/bin/luajit: /usr/share/lua/5.1/trepl/init.lua:384: ...ython2.7/dist-packages/digits/tools/torch/logmessage.lua:4: attempt to call field 'class' (a nil value)
stack traceback:
[C]: in function 'error'
/usr/share/lua/5.1/trepl/init.lua:384: in function 'require'
...b/python2.7/dist-packages/digits/tools/torch/wrapper.lua:10: in main chunk
[C]: in function 'dofile'
/usr/lib/luarocks/rocks/trepl/scm-1/bin/th:145: in main chunk
[C]: at 0x00406670
The previous steps included installing the dpnn package using luarocks.
Any pointers to the above errors ?  Should any env variables be set or additional configs required to sort out the dependencies ?  Or is there a compile issue ?
_Ben

Try to install lua-pb with the following command:
luarocks install --server=http://luarocks.org/dev lua-pb
Do it in any folder. It should install the pb dependencies. Then restart the Digits.
The original site is:
https://luarocks.org/modules/akhaustov/lua-pb


[core] Enable loose mode for staged featues

By default babel tries to fit better in spec. But most of restrictions
just do not affect usual code. This diff enables loose mode for stage-1
preset. As a result babel requires less actions and less helpers.
🚀 We saved here ~17KB of the code which is parsed with browser. And ~1KB of
gzip space because a lot of stuff was a duplication.

I have tried using the loose mode for all the transforms plugin with no luck. Nice idea to only target the stage preset! The next release is going to be significantly smaller. This is awesome!


Move build and e2e into one pod

Signed-off-by: Jenny Li<EMAIL_ADDRESS>/kind improvement

/hold


Terraform the billing alert

💡 Description

See alert configured https://us-east-1.console.aws.amazon.com/billing/home#/budgets/details?name=EN Monthly Cost Budget

Hi @jordanpadams since you already created the alert that is what we figured what remains to be done. You can decide on the priority of that.


Added a new cuda regression test to initialize, load binary run and finish twice

This regression test is related to issue #300 but doesn't fix it yet.
On both F1 and cosim, the first kernel runs fine but the second kernel hangs.
Should be merged in with bsg_manycore PR # 67.

Awesome! @soctar If we give you a .vcd file would you be able to put it into the undebugger?

Most definitely! If it's from VCS, it's helpful to have the VPD file as well, on the chance that you'd like to decompose structs.

I can give you the vpd file instead!

Or rather - @bornaehsani Can you give Neil the vpd file that is generated when you run this test?

Sorry for the late response, and yes of course, however the file seems too large to send over, but Neil and I are planning to meet tomorrow so I can learn how to set up the debugger, perhaps we can go over it tomorrow together. Thanks!

Definitely suggest the smallest binary that manifests the problem, so you
are hunting for your needle in the small haystack possible. :-) VCD files
are very compressible, as well, but you can hand the file off on xor
diskbits.
On Thu, Jun 20, 2019 at 10:34 PM Borna Ehsani<EMAIL_ADDRESS>wrote:

Sorry for the late response, and yes of course, however the file seems too
large to send over, but Neil and I are planning to meet tomorrow so I can
learn how to set up the debugger, perhaps we can go over it tomorrow
together. Thanks!
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/bespoke-silicon-group/bsg_f1/pull/305?email_source=notifications&email_token=AEFG5AGA2O426QXXYXUMB5LP3RR77A5CNFSM4HZ7NKE2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODYHPEYI#issuecomment-504296033,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AEFG5AB6DZZI3IWFG4O6WUDP3RR77ANCNFSM4HZ7NKEQ
.


#106: add collapsable issue view in PRs  (closes #106)

Issue #106
Test Plan
tests performed

@FrancescoCioria I made changes

@FrancescoCioria I made changes

did you? I can't see them :P

Ooops
On Sun, Feb 5, 2017 at 7:46 PM Francesco Cioria<EMAIL_ADDRESS>wrote:

@FrancescoCioria https://github.com/FrancescoCioria I made changes
did you? I can't see them :P
—
You are receiving this because you were assigned.
Reply to this email directly, view it on GitHub
https://github.com/buildo/github-workflow-pal/pull/108#issuecomment-277539638,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADINrIoawClU8N4AnPoYZF7pmpdjLJrRks5rZhjzgaJpZM4L2ZxF
.

--
Francesco Giordano ~ buildo


Updated source for us/tx/houston

Houston, TX seems to be failing lately. I found an ArcGIS Server endpoint that may be a viable replacement:
http://mycity.houstontx.gov/ArcGIS10/rest/services/wm/MyCityMapData_wm/MapServer/119

Seems to be resolved by #4512 via ea58a87da42043ab27dc51ab767f84531362ce64.


MAINT Fix a typo for March of 2008 in interesting periods.

I found a typo in interesting_periods.py: in line 51, PERIODS['Mar08'] was 20080301 to 20070401. So I create this branch and fixed the typo.

Thanks @bingyao.


Remove unused using declarations. [phab:D1121]

Created by fromberger at 2016-10-26 14:00:28:

shahms accepted this revision at 2016-10-26 14:44:52

fromberger closed via commit ba77dbbba07e6d20f59faa962548a403bd896f38 at 2016-10-26 14:45:59


No regex for the TSV

http://i.imgur.com/jnyvUFG.png
It also works with letters and all. The TSV should be a number between 0 and 4095.

/[0-3]\d{3}|40(?:[0-8]\d|9[0-6])/

Done.


Can the standard library benefit from this?

It is my understanding that the main motivation for this library is avoiding the overhead of the std::fmt infrastructure, but I noticed that unlike itoa this isn't the implementation from libcore but an independent one. It's the same basic algorithm (Grisu) but perhaps the separate lineage of the code means there are some optimizations in this implementation that the libcore implementation would also benefit from?

There are some differences that would make it a big breaking change for libcore to switch to this implementation. This library formats 1.01e5 as 101000.0 while libcore currently formats it as 101000. This library formats 1.01e101 as 1.01e101 while libcore currently formats it as<PHONE_NUMBER>0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. I don't think the performance would be worth breaking people's existing expectations about the representation.
For itoa I filed https://github.com/dtolnay/itoa/issues/1 to fix the implementation in libcore because that one is a pure performance improvement with no other user-facing differences.

Oh, so the speedup is mostly because fewer characters need to be written? That is something that can be fixed to some degree. You're right that the format of float.to_string() can't just change — this was attempted before and rejected, because it actually broke code relying on things like "float strings don't contain e".
However, there have been proposals to change this or that part of the format, possibly behind non-default format strings (e.g. {:#} instead of {}): rust-lang/rust#30967 rust-lang/rust#29472 and perhaps more. I think an RFC that defines alternative, shorter formats would result in a lot of bikeshedding but ultimately be accepted. Maybe in a few weeks I'll get around to writing such an RFC.

Oh, so the speedup is mostly because fewer characters need to be written?

Yes and no. The most dramatic speedups are because of that, but even numbers that print out exactly the same are faster by a factor of 2. This is because we avoid the overhead of the std::fmt infrastructure as you said initially.
I would support having this algorithm behind a non-default format string in the standard library.


select same date , no necessary to update

when I want to add recommend Date to this, dp.pageChange event is needed

@Eonasdan can you please leave us a note that why close this PR?
there is 2 modification in the PR:

do NOT fire event while use keep clicking the same date
fire an event while month page changed by user


[Sinytra Connector] Stuck at 90%

Issue description
When loading Oritech 0.10.3 for version 1.21.1 on NeoForge with Sinytra Connector the game refuses to load past 90%.
Steps to reproduce

Add Sinytra Connector, Oritech and its dependencies into the mods folder. (I use the forge versions of GeckoLib Athena, and OwoLib I also put the Fabric version of Lavender in there as well)
Boot the game and get stuck at 90%

Minecraft version
1.21.1 (Latest)
Fabric loader version
N/A
Fabric API version
forgified-fabric-api-0.104.0+2.0.15+1.21.1
Oritech version
0.10.3
Other relevant versions
connector-2.0.0-beta.3+1.21.1-full
forgified-fabric-api-0.104.0+2.0.15+1.21.1
geckolib-neoforge-1.21.1-4.6.6
owo-lib-neoforge-0.12.15-beta.6+1.21
lavender-0.1.13+1.21
athena-neoforge-1.21-4.0.1
If a (crash)log is relevant for this issue, link it here: (It's almost always relevant)
https://pastebin.com/raw/RUUnVbqU

Same Issue here, stuck at loading screen. Though after a couple of seconds I can hear the Menu BGM but still stuck at the loading screen.
NeoForge 1.21.1
I tried to confirm whether it was an issue with the dependencies so I loaded mc with them (lavender, owo-lib, geckolib & athena with indium) first (as well as some other performance & utility mods (listed below)). I was able to get in and create a world without issue. But as soon as I add Oritech, it all just freezes.
Mods used:
Oritech related:

oritech-0.10.3
forgified-fabric-api-0.104.0+2.0.14+1.21.1
owo-lib-neoforge-0.12.15-beta.6+1.21
lavender-0.1.13+1.21
geckolib-neoforge-1.21.1-4.6.6
athena-neoforge-1.21-4.0.1
indium-1.0.35+mc1.21

Others installed

BetterF3-11.0.2-NeoForge-1.21.1
better_modlist-1.1.6
cloth-config-15.0.140-neoforge
connector-2.0.0-beta.3+1.21.1-full
ConnectorExtras-1.12.1+1.21.1
dynamic-fps-3.7.4+minecraft-1.21.0-neoforge
eco_stack_manager-neoforge-1.21.1-1.3.1
ferritecore-7.0.1-neoforge
ImmediatelyFast-NeoForge-1.3.0+1.21.1
sodium-neoforge-0.6.0-beta.2+mc1.21.1
sodiumdynamiclights-neoforge-1.0.9-1.21.1

Btw, Reborn Energy API 3.0.0 is listed as a dependency and I don't have it as I'm not sure where to get it. Can't find it on Modrinth and Curseforge search gives me the Tech Reborn mod, is that it? Or is it this one? https://github.com/TechReborn/Energy. The latter has energy-3.0.0.jar but it just crashes mc, so I removed it.
Debug & Latest logs attached:
debug.log
latest.log

同样的问题，希望有neoforge版本的oritech，Sinytra Connector在之前的0.9.1oritech还是可用的。

更新oritech到0.10.3就无法运行了

Reborn Energy API is included as a jar in jar. No need to install it again.
Also Neoforge version is under development.
As for the bug, I guess there is something wrong with latest-updated Mixins.
@viro233 别急，作者说已经开始开发neoforge版本了

@OakPlatinum 我发的图是可以正常运行的时候的模组列表，更新oritech到0.10.3后删哪个或者删掉哪些可以恢复运行...

Hi, please report this issue on the sinytra side, as there's nothing I can really do about this on my side. Oritech used to work wth sinyttra, but currently appears to be broken. Try using owo lib vversion 0.12.11, as later version seem to break with sinytra connector. Go check out the open issues here: https://github.com/Sinytra/Connector/issues/1436 and https://github.com/Sinytra/Connector/issues/1420


Remove deprecated isIncludePrivate method from GroovyDoc for Gradle 8.0

Fixes #21657

@bot-gradle test this

OK, I've already triggered the following builds for you:

PullRequestFeedback build

@bot-gradle test and merge

Your PR is queued. See the queue page for details.

There's merge conflict between your PR branch and base branch. Please fix it and try again.

@bot-gradle test and merge

OK, I've already triggered a build for you.

Pre-tested commit build failed.

@bot-gradle test and merge

OK, I've already triggered a build for you.

OK, I've already triggered a build for you.


InfluxDB 0.9 doesn't like 0-value metrics

We should either filter those out at collector level or stop sending them in numbat-haproxy.

in numbat-process / generally i want to send 1 or -1 for zero so that i can identify any zero time ranges as missing metrics.


ForestDB exception in query iterator

In following the steps to verify https://github.com/couchbase/couchbase-lite-java-core/issues/964#issuecomment-176606050, I noticed the below exception when logging in at step 4 (now successfully logs in)
02-01 12:12:17.636 15216-15216/? D/ToDoLite: Turn on progress spinny
02-01 12:12:17.646 15216-15216/? D/ToDoLite: Sync progress changed.  Completed: 0 Total: 0 Status: REPLICATION_ACTIVE
02-01 12:12:17.646 15216-15248/? E/View: Error in regularQuery()
                                         ForestException{domain=2, code=-12}
                                             at com.couchbase.cbforest.QueryIterator.next(Native Method)
                                             at com.couchbase.cbforest.QueryIterator.next(QueryIterator.java:9)
                                             at com.couchbase.lite.store.ForestDBViewStore.regularQuery(ForestDBViewStore.java:363)
                                             at com.couchbase.lite.View.query(View.java:358)
                                             at com.couchbase.lite.Database.queryViewNamed(Database.java:2108)
                                             at com.couchbase.lite.Query$2.run(Query.java:483)
                                             at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:422)
                                             at java.util.concurrent.FutureTask.run(FutureTask.java:237)
                                             at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:152)
                                             at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:265)
                                             at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1112)
                                             at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:587)
                                             at java.lang.Thread.run(Thread.java:841)
02-01 12:12:17.646 15216-15216/? D/ToDoLite: Turn on progress spinny

Full gist - https://gist.github.com/sethrosetter/93dd0a88503cf28aefa0#file-gistfile1-txt-L4-L17

Error -12 is FDB_RESULT_ITERATOR_FAIL which is what ForestDB returns at the end of an iteration, but it shouldn't be passed on to Java as an exception.

@snej, Thank you for your input.

This looks like a bug in the CBForest C API, and I'm wondering if it's a regression from Friday's fix. Does this show up in unit tests?

So, I have a PR with a speculative fix for this (see above) ... how can we test it out? @hideki or @sethrosetter, could you apply that change (2 lines), build ToDoLite, and try the steps to verify #964?

Hi @snej,
By applying your fix, this Exception is no longer  printed.
Thank you very much for your quick fix!

@hideki I'll keep this issue open until you can confirm that new CBForest binaries are built and packaged.

As of 1.2.0-32 (41bbb374674612eaaa513a709deb5862360dcc8b), I am not longer able to the above Exception when following the steps to reproduce.

@zgramana I have verified that I can no longer repro the exception after testing with the build above. I will leave it to you to close per your comment above.

:+1:


Add product attribute in product url, avoid 301 redirect

All product links in the sitemap generates a redirect 301 if there is a combination for this product. We prefer to have link with no redirect. So we added the id_product_attribute to the link generation and we removed anchor for better url.

Hi @cedricfontaine,
It is OK :heavy_check_mark:

Before we have like this

We need a confirmation from our Product team
Ping @PrestaShop/prestashop-product-team what do you think?
Reported here: https://github.com/PrestaShop/PrestaShop/issues/16984
Thanks!

Hello @cedricfontaine , thanks for your feedback.
Isn't it better to send to the canonical URL ? Since 1.7.6, the canonical URL for products with combinations is available, preventing an automatic 301 redirection.

Hello @colinegin,
Yes, it's better to use the same canonical everywhere.

Thanks @cedricfontaine, so i guess we can close this PR right ?

Yes


Logging

Add useful logging in the core implementation.
Investigate logging provided by client implementations
Add logging summary to user guide

This has been addressed in the development branch and will be in the next release.


Issues with components on NPM packages and latest version

Hi!,
We are testing the upgrade from 2.2.1 to the latest 2.3.1. Our current solution involves having multiple LWC components in different NPM packages and that has been working fine for the past few months, but after upgrading we are getting MODULE_NOT_FOUND issues and our application does not work anymore. I am adding here as much information as I can:
NPM package A:
lwc.config.json
{
  "modules": [
    {
      "dir": "src/modules"
    }
  ],
  "expose": [
    "c/component1",
    "c/component2",
    "c/component3"
  ]
}

Client app:
package.json
{
  ...
  "dependencies": {
    "@XXX/npmpackage": "230.0.0-beta.572",
    ...
  },
  ...
}

lwc.config.json
{
  "modules": [
    {
      "npm": "@XXX/npmpackage"
    }
    {
      "dir": "src/modules"
    }
  ],
  "expose": []
}

After running the project, we are getting the error: Error: Cannot find module '@XXX/npmpackage
Also, we are using a custom webpack.config.js to add extra configuration to webpack like plugins and webserver configuration, plus the following config:
{
   ...
   resolve: {
        symlinks: false
    }
}

Any advice to see if something changed or if this is a bug?
Thanks!
-Armando

I will comment here if anyone has issues later:
I backtracked the issue to the change on this commit: 380fdc3c3d60d74837b8c97ed452f6bc065eace1
Previously, the NPM was resolved without validating the package.json, but, since version 2.3.0, it checks if the package has main on the package.json. Our package had an invalid main property as the file does not exists, making the resolve  invalid. Removing the main property or pointing to a valid file resolves the issue.

I will comment here if anyone has issues later:
I backtracked the issue to the change on this commit: 380fdc3c3d60d74837b8c97ed452f6bc065eace1
Previously, the NPM was resolved without validating the package.json, but, since version 2.3.0, it checks if the package has main on the package.json. Our package had an invalid main property as the file does not exists, making the resolve  invalid. Removing the main property or pointing to a valid file resolves the issue.


Parens can be nested

test("parens can be nested", t => {
  t.is(calculate("30/((1+2)*2)"), 5);
});

Fixed by https://github.com/jouni-kantola/calculator/commit/ea94bd99638ceb42159527c4663d5895306646a1


Wake up suspended scheduler threads if there is work for another one

Prior to this commit, suspended scheduler threads would not be woken
up even if there was more than one actor to be run in parallel.
This commit changes things so that if a scheduler thread has more
than one actor that has work to be done, it will wake up a suspended
scheduler thread to run the additional actor in parallel.
Resolves #3151.

This PR technically does not resolve #3151 because the pathological example in that issue still exhibits the same behavior as without the changes in this PR. Pathological here means significant work being done in the create constructor instead of calling a behavior to do the actual work once the actor has been successfully constructed by create. Just as GC in Pony only works between behaviors, the scheduler scaling logic to determine if scheduler threads need to be resume relies work being done across behavior calls function correctly. The following examples should hopefully illustrate what I'm referring to.
If I run a slightly modified version of the pathological example (to increase the array size so I can reproduce the issue locally), htop shows only 2 scheduler threads in use out of a total of 8 available (before or after this PR):
use "collections"
actor Main

      new create(env:Env) =>
            var size:USize = 100 * 1024 * 1024
            var worker:USize = 100

            var arr:Array[I32] = Array[I32].init(0,size)

            for i in Range(0,worker) do
                  Worker(4096)
            end

actor Worker
      new create(size:USize) =>
            for i in Range(0,size) do
                  for j in Range (0, size) do
                        var current:USize = 0
                        for k in Range (0, size) do
                              current = current + (i * j* k)
                        end
                  end
            end

If I run the following less pathological variant, htop shows 7 scheduler threads in use out of a total of 8 available (after this PR; it shows 2 before):
use "collections"
actor Main

      new create(env:Env) =>
            var size:USize = 100 * 1024 * 1024
            var worker:USize = 100

            var arr:Array[I32] = Array[I32].init(0,size)

            for i in Range(0,worker) do
                  Worker(4096)
            end

actor Worker
      new create(size:USize) => do_work(size)

      be do_work(size:USize) =>
            for i in Range(0,size) do
                  for j in Range (0, size) do
                        var current:USize = 0
                        for k in Range (0, size) do
                              current = current + (i * j* k)
                        end
                  end
            end

If I run this last variant, htop shows all 8 scheduler threads in use out of a total of 8 available (after this PR; it shows 2 before):
use "collections"
actor Main

      new create(env:Env) =>
            var size:USize = 100 * 1024 * 1024
            var worker:USize = 100

            var arr:Array[I32] = Array[I32].init(0,size)

            for i in Range(0,worker) do
                  Worker(4096)
            end

actor Worker
      new create(size:USize) => do_work(size)

      be do_work(size:USize) =>
            for i in Range(0,size) do
                  do_sub_work(i, size)
            end

      be do_sub_work(i: USize, size:USize) =>
                  for j in Range (0, size) do
                        var current:USize = 0
                        for k in Range (0, size) do
                              current = current + (i * j* k)
                        end
                  end

Given the above examples, I believe this PR resolves the core issue and the pathological case shouldn't be a concern as it goes against Pony best practices.

Great PR!
This might be a good hint for the performance chrat sheet.


Link to database is incorrect

Dear,
Thanks for your tool.
Sadly the link to the SNP database for the 1001genome project doesn't work. In the main page it is said that we can download from https://gmioncloud-my.sharepoint.com/personal/uemit_seren_gmi_oeaw_ac_at/_layouts/15/guestaccess.aspx?folderid=0ca806e676c154094992a9e89e5341d43&authkey=AXJPl6GkD8vNPDZJwheb6uk
From where I can get the database to tun SNPmatch?
Best,
Jose

Hello Jose!
Thank you for pointing it out! We have uploaded the data in figshare are in the paper, and here are the links. Shall update these links in the Readme
https://figshare.com/collections/_/3722743
Cheers,
R


No "Join our Discord!" on Cat Stand server

why?

Join our Discord!

Join our Discord!

Join our Discord!

Join our Discord!

This is definitely a "Join our Discord!" moment

tbh what you're suggesting makes complete sense but the way that it is is funny so

🤯


enhancement: enable grid view for CoreList component #412

Enable grid view for CoreList component, so that all children (CoreListItem) appear on grid.
The new variant (GRID) should also support the following:

[ ] props for number of items in every row for different screen sizes (default, sm, md,...)
[ ]  props to enable toolbar
[ ] toolbar to navigate between LIST and GRID, preferably multiple GRID sizes (like 3 items per row OR 4 items per row OR ...)
[ ] the toolbar should also have a search (this will only search in the already rendered items)
[ ] Support lazy loading for the CoreList
[ ] CoreListSubHeader is getting wrapped
[ ] if a array is sent inside the list it will create a list

donot merge it


separate training

if I trained only SAM on medical data by example and used DINO and stable diffusion without training. Does this consider the right direction to get something useful or do I have to train them all at once?

if I trained only SAM on medical data by example and used DINO and stable diffusion without training. Does this consider the right direction to get something useful or do I have to train them all at once?

Actually I think you should finetune GroundingDINO on medical datasets too to build the whole pipeline~ As u can see our demo is built upon groundingdino and sam


How do I set other icons?

In the project I do not use FA icons. I have a local file with icons. Consequently, css classes are also others.
Disable autoload FA can this option:
autoDownloadFontAwesome

But how to replace all fa fa-* to other classes?

Not even just a class. I tried to manually edit button.
The problem is that your editor is strongly integrated FA icons.
Other icons simply can not normally penetrate.

The only way at the moment would be to fork the repository and update the CSS source file.


Invert start offset on AnimationNode custom timeline

Custom timelines were added in https://github.com/godotengine/godot/pull/87171. Its purpose was to set the period of a loop animation, moving the timeline by the number of offsets.
This functionality could be reused to specify section, but in its current behavior, it would set the negative value there generally. Then, it is not consistent with AudioTrack's offset behavior and violates affordance, so the sign must be inverted.

Thanks!


Build Mobilenet as shared library

Problem description:
I want to build graph_mobilenetv2 as a shared library. So I have to make changes in Sconscript file. But I am not sure what changes I should do? Please help

Not exactly best practice, but you can see here where I use CMake to build an example.
The workflow there is explained in the minimum working example (MWE) README, but succinctly you could have ARMCL prebuilt, then build graph_mobilenetv2 using CMake, linking the ARMCL to it.
You can build shared libraries quite easily with CMake, see this Stack Overflow post if you haven't used that functionality before.
Maybe this will help, but I'm still finding my feet here too, so don't take what I say as gospel.


Partner list of companies receiving money from politicians

Hi @Irio! Could you please clarify which are the source to collect the data? Or we just need to be creative? :)
Thank you.

Hi @anapaulagomes, the short answer is we just need to be creative hahaha…
The long answer is that we have talked about some possibilities: some info is available in the Federal Revenue (search for a CNPJ, then click on “Consulta QSA / Capital Social” or something like “Certidão de Baixa de Inscrição” if the company is inactive). Unfortunately this if under a CAPTCHA. We have been in touch with people trying to code a workaround with a 10% of success rate if that helps. The juntas comerciais also have this information, but their are related to each state so their API might differ considerably.
We can try to scrap LinkedIn or Facebook trying to scrap some data, but that might be difficult (no CNPJ to match, different names, different job titles, outdated and unofficial info etc.).
And there is also alternative sites to look up CNPJ info, but not sure if they offer any info on the partners.

Sure @anapaulagomes.
For main info about companies, we've been using ReceitaWS; it's fairly reliable, but as you can see in this example, does not include the partner list:
http://receitaws.com.br/v1/cnpj/02703510000150
{
    "atividade_principal": [{
        "text": "Restaurantes e similares",
        "code": "56.11-2-01"
    }],
    "data_situacao": "14/12/2002",
    "tipo": "MATRIZ",
    "nome": "FRANCISCO RESTAURANTE LTDA - EPP",
    "telefone": "(61) 3226-2626",
    "situacao": "ATIVA",
    "bairro": "ASA SUL",
    "logradouro": "Q SHC/SUL CL QUADRA 402 BLOCO B LOJA 05, 09, 15",
    "numero": "S/N",
    "cep": "70.237-500",
    "municipio": "BRASILIA",
    "uf": "DF",
    "abertura": "27/06/1988",
    "natureza_juridica": "206-2 - SOCIEDADE EMPRESARIA LIMITADA",
    "cnpj": "02.703.510/0001-50",
    "ultima_atualizacao": "2016-08-24T16:58:50.057Z",
    "status": "OK",
    "fantasia": "",
    "complemento": "",
    "email": "",
    "efr": "",
    "motivo_situacao": "",
    "situacao_especial": "",
    "data_situacao_especial": "",
    "atividades_secundarias": [{
        "code": "00.00-0-00",
        "text": "Não informada"
    }]
}

Here's a step by step to get them (as a user) from Federal Revenue's website, probably the best from the official sources:

Fill form with CNPJ and captcha.
https://cloud.githubusercontent.com/assets/667753/18273509/fa56d942-7413-11e6-8ac5-868f899aa5e5.png
Click on button "Consulta QSA / Capital Social".
https://cloud.githubusercontent.com/assets/667753/18273526/0b4e8d08-7414-11e6-8391-ffd7d23a1555.png
All yours.
https://cloud.githubusercontent.com/assets/667753/18273533/1352f818-7414-11e6-95ed-92acea5b9848.png

As mentioned by @cuducos, we know people breaking it using Tesseract (OCR), but frequently gets blocked by Federal Revenue's servers given its low accuracy of 10%. Another way I can think about breaking it is using Machine Learning; computer vision is one of the most researched areas in Deep Learning nowadays. e.g. https://deepmlblog.wordpress.com/2016/01/03/how-to-break-a-captcha-system/ (has a paper at the end)

Hi folks, first of all, I didn't get yet why we are talking in english...
The main idea is to discover the biggest amounts: it will be for printer bureau, Video producers and adversting companies. Restaurants or brothels would result just on tips and cents and we will not discover anything interesting.
So my suggestion is first to discover who are the big suppliers and which activities they made. After that, try to discover the partners.
An interesting buzz post: https://www.facebook.com/teofb/posts/1186854511378646
He did by hand without any programming ;)

If we use the voice recognition on audio captcha instead of OCR on image, it's not easier to recognize and more accurate?
It's just a idea, I don't know which is better.

Hi @josircg,
Welcome to Serenata de Amor. I'll try to address all your points, but let me know if I forget any of them, ok?

Hi folks, first of all, I didn't get yet why we are talking in english...

It's on the bottom of our README.md, the homepage of the project here at GitHub: A conversa sobre o projeto acontece em um grupo do Telegram — tudo em inglês, já que temos contribuidores de outros países e queremos contribuir com outros países também.
Does that make sense?

The main idea is to discover the biggest amounts […]

To keep it short: the main idea is to use computing power to find more cases than humans, doing it manually, would be able find. That's the purpose of the project. Surely big cases are eye-catching, but we depart from the assumption that corruption starts small — according to that there is an important value of focusing also on the small cases.

He did by hand without any programming ;)

This post is amazing, as it is OPS: they, doing it all manually, denounced and succeed in cases summing more than R$5 million. We do not compete or replace these example. We are inspired by them and try to expand their investigative power ; )

@Lrcezimbra's idea looks amazing! Is there any project/script using this strategy to break CAPTCHA?

Good inputs! I'd like to work on it (I can't assign to myself). I was looking for different sources and I found this interesting tool called Câmara Transparente developed by FGV.  I'll take a look on other sources and keep you updated.

not sure if we can get the data we want for this, but I just found this site http://www.consultasocio.com/
that allows listing what companies that someone is a partner, and the other partners in those companies for example http://www.consultasocio.com/q/sa/abel-salvador-mesquita-junior
we can try to scrap that data starting with the politician names, and create a database with what companies belongs to each deputy, who else is partner in those companies and the companies that belongs to those partners
if this will help, I can assign the issue to myself and write the scrapper

@urubatan I'm starting to work on this issue but you can certainly help! :) Maybe you can do the scrapper for this website also and I'll work in the another.

@Irio we have about 1 million companies with information about partners (QSA) in our database, such data is not acessible by an API but if you provide us with a list o names, we will be happy to run a search for it. All information was obtained from the Receita Federal website and is public. Please note that the QSA information does not include the CPF number, so searches are base on the name and therefore are subject to namesake.

@urubatan That sounds very promising.
@tomascamargo Would be possible to query 433 names? 👀 These are all the unique congresspeople listed since the creation of CEAP.

@irio great, my python is not great (planning to help the project to learn python and data science :P ), but I'll write a scrapper for that and send a pull request.

@irio yes we try with this. Can you please provide us the names.

Hey guys, I was able to get the information from the main site without needing CAPTCHA, I'm finishing a poc here and will send you.

@mtrovo have you published the results?

I published to https://github.com/awerlang/cnpj-rfb a tool to fetch a company partner list (only names). There's manual step requiring you to visit RFB website then the rest is automated. I found some companies break the process, then you'll need to repeat. It would be best to filter this companies ("baixada", "natureza jurídica inválida", "S.A."). I guess this is our best shot atm.
If anyone have a list of all the companies we need to query let's run through this tool.

This is a list with 8417 CNPJs and CPFs found on expenses in 2016 up to now. Also I'm attaching ~80 CNPJs I was able to fetch with the tool I anounced the other day. Currently I'm experiencing a connection reset every ~40 operations (ECONNRESET, and I'm not able to access the web page on RFB for some time), that would mean about 200 runs ~= several days. And we would want to run on 2015 data too.
Also I updated the tool to ignore CPFs, and CNPJ entries with certain conditions that would lead to error conditions.
Help is most appreciated! How can we unblock HTTP access in this situation?
https://gist.github.com/awerlang/3a8b3f286a0bcceb2ae367ad2e09af21

Summarizing this topic
I'm sorry if my statements looks like I'm pointing to failures but I wan't to highlight what the pain-points really are.
@tomascamargo has a great private database. If we ask you for a query for a long list (60k) of CNPJ, would you generate a simple dump for us (cnpj, partner) — in case of more than one partner, one cnpj could be repeated in subsequent rows? If so, I'll export a list of CNPJ today.
@awerlang Your solution looks great — it's the best we have so far, but restaring it, plus latency due to probable server-side block, plus manual session ID copying and paste is still an issue. Maybe the barrier is as great as breaking the captcha (10% rate of success and successive blocks). If @tomascamargo can bootstrap this dataset with a query in his system, we can use your solution to update the dataset when we get new data from the Lower House.
@urubatan Consulta Sócio is useful to get companies registered in politicians' names, but it would also be very interesting to have the full list of partner (get companies held by politicians relatives as in #107 for example). That's why I'm still writing in this Issue ; )
I'm willing to put some effort in this issue to create this dataset. I'm glad for all the discussion, references and opportunities. Let's put the pieces together to make it work ; )

Fresh news about Consulta Sócio:
http://convergenciadigital.uol.com.br/cgi/cgilua.exe/sys/start.htm?UserActiveTemplate=site&infoid=44189&sid=4&utm_source=dlvr.it&utm_medium=twitter
If we get this database, it should be obfuscated somehow or it can be a trojan horse against whole project.

@cuducos I see you guys are having some trouble breaking captcha. There are services that use humans to resolve the captcha. You can see some examples here: https://www.troyhunt.com/breaking-captcha-with-automated-humans/.

@pedrommone even if you break captcha (which is a non-issue) you'll get blocked by RFB servers after a few requests.

@awerlang so, the main problem is the request limit throttle? If its, using Tor as a proxy make some sense here.

Won't the proxy get blocked too?

@awerlang inside tor networking, every request you do, you can force it use a different IP. If you want more info, go here: https://deshmukhsuraj.wordpress.com/2015/03/08/anonymous-web-scraping-using-python-and-tor/

@pedrommone actually breaking the captcha is not the real issue (check #42). We just miss a script that automatically use one captcha breaking solution to collect all the info we need. The closest we got was @awerlang's solition (posted in thia topic).

oh, thanks for information @cuducos.
@awerlang now, I guess, you can easily unblock http requests with TOR :)

@pedrommone I won't be pursuing this route for the moment. Thanks for sharing this information though.

Guys, have you already checked again the ReceitaWS?
Querying the same example that @Irio did above (http://receitaws.com.br/v1/cnpj/02703510000150), I can get the partners lists:
{
  "atividade_principal": [
    {
      "text": "Restaurantes e similares",
      "code": "56.11-2-01"
    }
  ],
  "data_situacao": "14/12/2002",
  "nome": "FRANCISCO RESTAURANTE LTDA - EPP",
  "uf": "DF",
  "telefone": "(61) 3226-2626",
  "qsa": [
    {
      "qual": "22-Sócio",
      "nome": "CINTHIA MAYUMI KITAHARA"
    },
    {
      "qual": "49-Sócio-Administrador",
      "nome": "GIULIANA ANSILIERO"
    },
    {
      "qual": "22-Sócio",
      "nome": "EDSON RICARDO MONTESCHIO NUNES"
    },
    {
      "qual": "22-Sócio",
      "nome": "BRUNA MONTESCHIO NUNES MARQUES"
    }
  ],
  "situacao": "ATIVA",
  "bairro": "ASA SUL",
  "logradouro": "Q SHC/SUL CL QUADRA 402 BLOCO B LOJA 05, 09, 15",
  "numero": "S/N",
  "cep": "70.237-500",
  "municipio": "BRASILIA",
  "abertura": "27/06/1988",
  "natureza_juridica": "206-2 - Sociedade Empresária Limitada",
  "cnpj": "02.703.510/0001-50",
  "ultima_atualizacao": "2017-02-11T04:37:40.742Z",
  "status": "OK",
  "tipo": "MATRIZ",
  "fantasia": "",
  "complemento": "",
  "email": "",
  "efr": "",
  "motivo_situacao": "",
  "situacao_especial": "",
  "data_situacao_especial": "",
  "atividades_secundarias": [
    {
      "code": "00.00-0-00",
      "text": "Não informada"
    }
  ],
  "capital_social": "0.00",
  "extra": {}
}

Maybe they had updated the service. =)
/cc @Irio @cuducos

That's awesome! And this issue now is about adapting the current scripts to save that info — which is way easier!
Thanks for the heads up, @marcusrehm!

Hey guys, is there anyone working on this issue?

AFAIK there isn't. @jtemporal and I took a look on the two scripts collecting data from ReceitaWS we felt that they could be refactored before collecting data again — but this is not our priority right now. Feel free to jump in, coding or discussing ; )

same thing here, AFAIK there isn't. Feel free to adopt it @marcusrehm ;) it would be much appreciated

Yes! I can get this one. Actually I was waiting for this one to be done so we could play with that data on neo4j... :smile:
Could you please point out which scripts are related to this issue? If you can, we can discuss about the refactoring also, then we can see what can be done along with the inclusion of the partners list.
/cc @jtemporal @cuducos

Two scripts basically: fetch_cnpj_info.py and clean_cnpj_info_dataset.py. My comments in favor of a massive refactor:

The script is not so effective: it easily started to be blocked by ReceitaWS and we have to re-run it several times
Maybe no cleaning process could be done in a parser logic, not in an external script

The script is not so effective: it easily started to be blocked by ReceitaWS and we have to re-run it several times

Just checked: Try to better handle 429 too many requests responses

Maybe no cleaning process could be done in a parser logic, not in an external script

And maybe move it to the toolbox

I think we can work on the data acquisition, coding the script to fetch the new data. After that we can work on the issue about request, in the end this one is needed in order to grab the data.
About the requests, do you know or have already tried use Tor? I was thinking about use it and in case it isn't allowed on the client network the script can then use batch processing to request in a specific time frame.
Then we can refactor the whole script, but we will already have the logic to get this running.
What you think?

About the requests, do you know or have already tried use Tor?

TBH I just used Tor browser manually, that is to say, never integrated in a Python script. If this is possible and if this doesn't require a too specific setup (so contributors can get started in the project easily) I have no concerns about it. Otherwise I think that a proper handling of HTTP 429 and maybe some semaphore controlling the amount and frequency of requests might be enough.

I think we can work on the data acquisition, coding the script to fetch the new data.

Sure thing. I think it is a good start to start with data collection and once we can gather the information we're looking for we can look to the script and figure out the best way to deal with request traffic ; )

Hey Guys! Just got the script fetching and saving the partners list. It's available at my repo. It's the same script but saving the data of partners, now I'm working to better handle the 429 error related with too many requests.
About the 429error, I think Tor is not a good option as people need to install it apart from serenata de amor and I think it is out of scope for the project (as @cuducos mentioned, it should be easy for the contributor to setup). So I started to work in handling the requests errors and I got some concerns about the script:

I think it's better use a sequencial approach to make the requests rather than paralelize (as the script do now) because I think parallelism improves the chance to get 429 too fast and besides that I also getting [Errno 24] Too many open files after handle the 429.
If we remove the parallelism there's no need to save data in pkl files and then put it on a DataFrame, we could do it right after get the data from receitasWS.
Other point wold be put companaies.xz and companies-partners.xz dataset's using the naming format yyyy-mm-dd-datasetname.xz as we use in others datasets. It helps in getting versions of the data and preserving data used in some analysis. For this we need to now the impact on other scripts.

Do you have any concerns about the points above or I can continue with this approach?
/cc @cuducos @jtemporal

Yaay this is awesome! I believe you are about right on that approach, AFAIK the parallelism part was used so we could generate the dataset faster, right now if we remove de the parallelism and get it to work properly, we can think about parallelize it again later. =)

Cool @jtemporal ! I'm gonna do it this way then.
And about the file naming convention? Do you think that it is ok also?!

Good points, @marcusrehm — I agree with you and @jtemporal on everything you've said. ABout the naming convention: we could have just YYYY-MM-DD-companies.xz I guess, addressing the partner names the same way we did with secondary_activity_XX[_code_]. Maybe the script wasn't versioning companies.xz, but we were doing it manually — it would be great to have it done automatically.

it would be great to have it done automatically

Automate all the things o/    🎉

Maybe the script wasn't versioning companies.xz

That's about right! Versioning was happening when the dataset was being uploaded to the S3.

Hey folks!
Got a new version of fetch_cnpj_info.py script here.
I brought the threading back but with some improvements. Now we can pass as arguments how many threads to use and a list of http proxies, so each request uses a randomly chosen proxy from the list or none (use the local ip). The script still taking time but fetches faster than old version.
Also for each batch of 100 requests it saves the cnpj-info.xz dataframe so if we have some issue or it interrupts abruptly we don't loose the work and the script can restarts from where it stopped.
The script can be called the same way as it is now (so nothing will break because of that) or it can be called as  python ./src/fetch_cnpj_info.py ./data/2016-11-19-current-year.xz -p <IP_ADDRESS>:8080 <IP_ADDRESS>:8080 <IP_ADDRESS>:3128 <IP_ADDRESS>:8080 -t 20 where -p or --proxies receives the list of proxies and -t or --threads the number of threads.
For the clean_cnpj_info_dataset.py I put the naming file convention to save the companies.xz file and adjusted partner list as @cuducos suggested here:

I guess, addressing the partner names the same way we did with secondary_activity_XX[code]. Maybe the script wasn't versioning companies.xz, but we were doing it manually — it would be great to have it done automatically.

My only concern about it is that wouldn't be easier to analyze data if we got it in a separate file? Having multiple columns with the "same" data can increase the difficulty to make filter or joins, don't you think?
I can create a PR so you guys can review and use it. Now I think we can work in bring the clean logic to the fetch script and have just one script for handle all process ok?
/cc @cuducos @jtemporal

Now we can pass as arguments how many threads to use and a list of http proxies

That's awesome!

The script still taking time but fetches faster than old version.

🎉 Many thanks, @marcusrehm!

My only concern about it is that wouldn't be easier to analyze data if we got it in a separate file?

That's totally fine IMHO ; )

I can create a PR so you guys can review and use it.

Sure thing. Once the PR is opened I can offer a proper code review, but in a quick look it looks as a very good improvement — again, many thanks for that.
Once you open the PR if you have a dataset generated you can add a link to it if you like ; )

Hey guys! It took more days than I thought but the PR #218 is there. When the dataset download finish I post the link here ok?

the link to download the dataset https://we.tl/Zsw7zPhV6a

Oops…

Sorry, this transfer has been deleted and is not available any more

It's our fault, we couldn't get back to this Issue/PR in time. Would you mind uploading it again here?

Does #218 closes this Issue? cc @jtemporal

Also the dataset is not available in the S3 yet, is it? Does anyone still have a copy so we can upload it? cc @jtemporal

I uploaded the file again https://we.tl/TTYzFTk5d8.
About close the issue, if this was just the acquisition of partners list, then I think it's done, but I didn't do any analysis with it (yet). :)
cc @cuducos @jtemporal

I think this is mostly related to the partner list. I'm pondering on two issues about this dataset before bringin it to S3:

For some reason it has less 7% companies than the last one (no idea why)
It misses the geo coordinates we added using Google Places API

So before making it available I would like to know about best practices in versioning (arguably similar) datasets:

Should we rename it to companies-no-geolocation?
Should we add geolocation to it?
Should we strip off everything but CNPJ and partner list (making it an complimentary dataset to the former companies dataset)?

What do you think @Irio?

When we first generated it, the companies.xz file already had geolocation (using src/geocode_addresses.py). I'm good with option number 1 if we work on number 2 later. @cuducos

I'm good with option number 1 if we work on number 2 later

I agree with this approach ;)

For some reason it has less 7% companies than the last one (no idea why)

I think I ran it using only the reimbursements dataset. Another reason could be that the last script were filling lines with blank info only with the message error for "CNPJ inválido".

Renaming it, opening an issue to add geolocation… and closing this issue! Hell yeah ; ) Thank you so much @marcusrehm 🎉
Closed by #218


feat: add installer and install script for linux and darwin

:tada: This PR is included in version 1.2.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


The project does not run on node js

The project at console only runs the first time that fires the "start" button Visual Studio. The second, third and in the other times that triggers the 'start' button (after stopping the first run) the project appears that is running (open the prompt, etc) but does not run in fact: to access the browser receives the error ERR_CONNECTION_REFUSED even NOT making any changes in the code.
Example: Creates a server on port 3000 that returns response as "Hello". On the first run, the browser will display "Hello". Stop the project. Start again. Refresh the page in the browser and will look: ERR_CONNECTION_REFUSED.

https://github.com/Microsoft/nodejstools/issues/31

Issue Reported: https://github.com/Microsoft/nodejstools/issues/31


Use PyBossa to crowdsource and clean org map data

In a nut-shell, PyBossa is a free, open-source crowd-sourcing and micro-tasking platform. It enables people to create and run projects that utilise online assistance in performing tasks that require human cognition such as image classification, transcription, geocoding and more. [Source]

Originally a suggestion from Helpful Engineering, but it seems like a great idea for validating the ~10K organizations on our global map of mutual aid organizations and for adding more across regions we haven't been able to reach (especially Asia and Africa).

ZenHub Information
This information is updated automatically. To modify it, please use ZenHub.

To start task, understand how pybossa works.  The requirement is to be able to create tasks for cleaning up data that volunteers can sign up for.  @schowdhury8 Can you confirm?


Linting to our ES5 standard

Linting to our ES5 standard, ahead of the change to ES6. ;)

Current coverage is 98.41% (diff: 100%)

No coverage report found for master at 261c9ff.

Powered by Codecov. Last update 261c9ff...c7d356d

👍


DAO Creation Token configuration fixes

Hide token must be wrapped message until we actually resolve whether imported token is votes token or not.
Disable token name and symbol inputs if imported token is votes token

Closes #2236
Closes #2237

Three things I spotted:

There is a bit of a delay between inputting the token address and the "wrapped" message popping up (alongside token info)
I'm still able to proceed to the next step to deploy the Safe, despite this message — should this be possible?
Bug happening when clicking on the space around the token address input field that changes my selection to "New Token"

Browser metadata
Path:      /create/erc20Token
Browser:   Chrome <IP_ADDRESS> on Mac OS 10.15.7
Viewport:  1465 x 904 @2x
Language:  en-US
Cookies:   Enabled

Open in BrowserStack

Open Deploy Preview · Mark as Resolved

Three things I spotted:

There is a bit of a delay between inputting the token address and the "wrapped" message popping up (alongside token info)
I'm still able to proceed to the next step to deploy the Safe, despite this message — should this be possible?
Bug happening when clicking on the space around the token address input field that changes my selection to "New Token"

Browser metadata
Open Deploy Preview · Mark as Resolved

I guess I see now after watching my recording back that we are wrapping the token. That is not clear at all that that is what is happening while ~in-the-flow~ when moving/clicking/deciding at normal behavior speeds. Big UX flag for me there.

When inputting an address for a wrapped token, I'm given that same Wrapped message and the name now says "wrapped wrapped"

Browser metadata
Path:      /create/erc20Token
Browser:   Chrome <IP_ADDRESS> on Mac OS 10.15.7
Viewport:  1465 x 904 @2x
Language:  en-US
Cookies:   Enabled

Open in BrowserStack

Open Deploy Preview · Mark as Resolved

When inputting an address for a wrapped token, I'm given that same Wrapped message and the name now says "wrapped wrapped"

Oh that's funny, I would expect that a Wrapped token implements IVotes already (which I believe is the thing that matters when determining whether or not the given token needs to be wrapped or not), so I wonder why we'd attempt to rewrap it.
@mudrila would you mind looking into that.

The Github Lint warning on this PR doesn't make any sense lol

@mudrila new issues for those items sounds good to me. Please get those created then feel free to merge this.
Thanks for your review @nicolaus-sherrill!

@nicolaus-sherrill regarding

There is a bit of a delay between inputting the token address and the "wrapped" message popping up (alongside token info)
I'm still able to proceed to the next step to deploy the Safe, despite this message — should this be possible?

Yes all of this is expected.

Delay is because there's a network call happening there
The info message is not a warning or error (blocking), just informational (non blocking)

Also understood, that you call into question the UX in general.


Add Rails 8 support

Fixes #458

coverage: 98.173% (-0.02%) from 98.188%
when pulling e6455d4cbf570024374b7d0c5446f73ee0788196 on olbrich/issue458-Add-Rails-8-support
into 49bca0d4a45defec6e5209a10c492198726b813a on main.


focusOnSelect no-op implementation requires unsafe-eval CSP content source

If !focusOnSelect then new Function is executed. This is actually code evaluation and requires the unsafe-eval Content Security Policy content source for script-src directive in order to work. We should allow clients to use strict CSP rules and deny unsafe-eval and replace new Function with something that does not require this content source.
I will create a PR for this.
https://developer.mozilla.org/en-US/docs/Web/Security/CSP/CSP_policy_directives#Keywords

@suniala, I think we should replace new Function with null and execute function only if it exits

@akiran, sure why not. I already created a pull request with another kind of solution but I can do a new one, if you prefer.

@suniala Thanks. That would be great

Done. Please see the updated pull request.

Fixed in release 0.14


MGMT-10254 Fix logout

:tada: This PR is included in version 1.1.13 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


keyboard shortcut: CONTOL+ENTER --> Start/Restart

I propose that CONTROL-ENTER will be keyboard shortcut for START / RESTART button.

how about CONTROL+C as an accelerator for the Stop button?

CONTROL-LEFT ARROW to go back from console to settings page

@chriskiehl closed the PR. Should I rebase pull#445 and reopen? Or are you not interested?
PS congrats for 1.0.3!!

Yeah, reopen please! : )
I got singularly focused on finally getting something out the door, so some of the open things got ignored along the way.
I often hit cmd+enter when testing in a pure muscle memory way even though it does nothing at the moment. Having that finally do something would be super.
Only comment would be that the specific accelerator keys, like everything in Gooey, should be configurable. I think your chosen defaults are good, but just allow them to be overridden.

@chriskiehl -  Do you have an example of someone making the accelerator keys configurable in a suitable way?

Are you asking for program examples or implementation examples?
If the former, I'd say most of the 'tool' software I use day-to-day allows customizing shortcuts. IntelliJ, SublimeText, Atom, event OSX itself let's you remap shortcut keys.
If the latter, you can handle the configuration and defaults via the build_spec that gets created in config_generator.py. Those get passed into the main wx application root.

I rebased this for 1.0.4 in #528 (and tested) . Unfortunately I don't see myself getting to add the configuration soon. Maybe it's a good idea to merge it as is and add the configuration later?


Fix Settings height

Currently the workday end time field is off screen and could be unnoticed.

@IndrekV I want to consult with you first on this one, how about this:
$("#stop-at-day-end").addEventListener("webkitTransitionEnd", function(event) {
 window.scrollTo(0,document.body.scrollHeight);
}, false);

This would make the window scroll to the bottom when the checkbox is clicked. Rendering the input field visible.

The logic was good just the #stop-at-day-end was not working. Thanks for the idea.