Referencing Timestamp fields in a @key requires dangerous additions to the schema

Describe the bug
In order to use createdAt as a sort key in a @key directive you have to include a field called "createdAt: AWSDateTime" (non-null) to stop the error but this then allows anyone to set/edit the createdAt/updatedAt fields via auto-generated mutations. This can be dangerous as now anyone can over-write the createdAt date and if running code with in multiple timezones or incorrectly set dates could get things out of sync.
Note: this was all tested using "amplify mock api", this hasn't been tested in the cloud yet (as pushes up the tests takes so long and mocking like this should be the same...right? But just in case, now you know).
To Reproduce
Steps to reproduce the behavior:
Try each of the code snippet below in your schema file and try to do a mutation to create a new TestType. Have "amplify mock api" running and http://localhost:20002 open
Expected behavior
When referencing the createdAt or updatedAt fields (or any rename of those fields via the timestamp attribute on the @model see https://docs.amplify.aws/cli/graphql-transformer/directives#usage) in a @key directive the schema should know that they are auto-generated fields and not complain that they don't exist in the schema an allow them through.
There are other ways this could be fixed but I think making the @key aware of autogenerated fields would be enough. This does raise the issue that the timestamp attribute on @model doesn't seem to hide the fields from mutations at all but I assumed it would as mentioned in the docs (https://github.com/aws-amplify/amplify-cli/issues/401#issuecomment-443319109), not sure if that is by design or an over-sight as hinted at here https://github.com/aws-amplify/amplify-cli/issues/401#issuecomment-443319109, the closing of that issue made me think this had been handled but looks like its not?
Code Snippet
# Test Query to run in Graphiql:
mutation AddTest {
  createTestType( input: {
    name: "Your test name here",
    # This shouldn't be available on a mutation
    createdOn: "2010-10-16T14:13:37.711Z"
  }) {
    name,
    createdOn
  }
}

# Schema changes, try each on in turn, each building on the other.

# This will work but no @key. createdAt will appear in Queries but not Mutations as expected
type TestType @model
{
  id: ID!
  name: String!
  test: String
}

# This will fail with "InvalidDirectiveError: You cannot specify a nonexistent field 'customerName' in @key 'byName' on type 'TestType'"
type TestType @model
@key(
  name: "byName"
  fields: ["name", "createdAt"]
  queryField: "testTypeByName"
)
{
  id: ID!
  name: String!
  test: String
}

# This fixes the error but createdAt appears in the Mutations!
type TestType @model
@key(
  name: "byName"
  fields: ["name", "createdAt"]
  queryField: "testTypeByName"
)
{
  id: ID!
  name: String!
  test: String
  createdAt: AWSDateTime
}

# Try explicitly telling it that this field is a timestamp, doesn't work as expected though, you can still set the createdAt field
type TestType @model(timestamps:{createdAt: "createdAt", updatedAt: "updatedAt"})
@key(
  name: "byName"
  fields: ["name", "createdAt"]
  queryField: "testTypeByName"
)
{
  id: ID!
  name: String!
  test: String
  createdAt: AWSDateTime
}

# I tried changing the field name to something else just in case to but still no luck
type TestType @model(timestamps:{createdAt: "createdOn", updatedAt: "updatedOn"})
@key(
  name: "byName"
  fields: ["name", "createdOn"]
  queryField: "testTypeByName"
)
{
  id: ID!
  name: String!
  test: String
  createdOn: AWSDateTime
}

Screenshots
Proof you can pass in the createdAt (or in this example createdOn) field with the autogenerated mutation:

Pete1 was set without passing in the createdAt date so the server set it as expected, Pete2 I set it myself and is in the past!

What is Configured?
amplify add api - GraphQL
Running mock mode only via "amplify mock api" and then going to http://localhost:20002

<details>
  System:
    OS: Windows 10 10.0.18363
    CPU: (4) x64 Intel(R) Core(TM) i7-6600U CPU @ 2.60GHz
    Memory: 991.53 MB / 7.92 GB
  Binaries:
    Node: 12.18.4 - C:\Program Files\nodejs\node.EXE
    Yarn: 1.22.5 - C:\Program Files (x86)\Yarn\bin\yarn.CMD
    npm: 6.14.8 - C:\Program Files\nodejs\npm.CMD
  Browsers:
    Chrome: 86.0.4240.75
    Edge: Spartan (44.18362.449.0)
    Internet Explorer: 11.0.18362.1
  npmPackages:
    @aws-amplify/ui-react: ^0.2.21 => 0.2.21
    @ideal-postcodes/api-typings: ^2.0.0 => 2.0.0
    @ideal-postcodes/core-browser: ^1.3.0 => 1.3.0
    @tailwindcss/ui: ^0.6.2 => 0.6.2
    @tailwindui/react: ^0.1.1 => 0.1.1
    @testing-library/jest-dom: ^4.2.4 => 4.2.4
    @testing-library/react: ^9.3.2 => 9.5.0
    @testing-library/user-event: ^7.1.2 => 7.2.1
    @types/jest: ^26.0.13 => 26.0.14
    @types/node: ^14.6.3 => 14.11.2
    @types/reach__router: ^1.3.5 => 1.3.5
    @types/react: ^16.9.49 => 16.9.49
    @types/react-dom: ^16.9.8 => 16.9.8
    @types/yup: ^0.29.7 => 0.29.7
    @typescript-eslint/eslint-plugin: ^4.0.1 => 4.2.0
    @typescript-eslint/parser: ^4.0.1 => 4.2.0
    apollo-boost: ^0.4.9 => 0.4.9
    aws: ^0.0.3-2 => 0.0.3-2
    aws-amplify: ^3.3.1 => 3.3.1
    aws-amplify-react: ^4.2.5 => 4.2.5
    aws-sdk: ^2.765.0 => 2.765.0
    eslint: 6.6.0 => 6.6.0
    formik: ^2.1.5 => 2.1.5
    graphiql: ^1.0.5 => 1.0.5
    graphql: ^15.3.0 => 15.3.0
    history: 5 => 5.0.0
    react: ^16.13.1 => 16.13.1
    react-apollo: ^3.1.5 => 3.1.5
    react-dom: ^16.13.1 => 16.13.1
    react-icons: ^3.11.0 => 3.11.0
    react-pagination-hook: ^0.0.1 => 0.0.1
    react-router-dom: ^6.0.0-beta.0 => 6.0.0-beta.0
    react-scripts: 3.4.3 => 3.4.3
    react-use: ^15.3.4 => 15.3.4
    tailwindcss: ^1.7.6 => 1.8.10
    typescript: ^4.0.3 => 4.0.3
    vest: ^2.2.3 => 2.2.3
    yup: ^0.29.3 => 0.29.3
  npmGlobalPackages:
    @aws-amplify/cli: 4.29.7
    @hint/configuration-development: 6.1.0
    @microsoft/rush: 5.22.0
    @types/angular: 1.6.54
    eslint: 3.19.0
    expo-cli: 3.0.10
    generator-code: 1.1.47
    grunt: 1.0.3
    gulp-cli: 2.0.1
    gulp: 4.0.0
    hint: 4.4.1
    node: 12.10.0
    npm-windows-upgrade: 5.0.0
    npm: 6.14.8
    protractor: 5.4.2
    rimraf: 2.6.3
    source-map-explorer: 1.7.0
    terser: 3.16.1
    typings: 2.1.1
    vsce: 1.57.1
    yarn: 1.22.4
    yo: 2.0.5

</details>

I am using the GraphQL Transformer v2 now and I had the same concern. Interestingly, I didn't find this when I was searching. Though this issue is quite old at this point I will share my thoughts in case others stumble upon it.
I found a workable solution is to still add the createdAt field to the schema but to add @auth rules onto it to deny users setting the value.
For example:

type Blog
  @model(timestamps: { createdAt: "createdAt", updatedAt: "updatedAt" })
  @auth(rules: [
    { allow: owner, operations: [create, read, update, delete] }
    { allow: groups, groupsField: "groups", operations: [read, update, delete] }
  ])
{
  id: ID!
    @auth(rules: [
      { allow: owner, operations: [read, update, delete] }
      { allow: groups, groupsField: "groups", operations: [read, update, delete] }
    ])

  name: String! @index(name: "byNameCreatedAt", sortKeyFields: ["createdAt"])
  description: String @default(value: "Powered by Foo Bar Blogs")

  posts: [Post] @hasMany(indexName: "byPost", fields: ["id"])

  createdAt: AWSDateTime!
    @auth(rules: [
      { allow: owner, operations: [read, update, delete] }
      { allow: groups, groupsField: "groups", operations: [read, update, delete] }
    ])
}

In this schema I am protecting id and createdAt, preventing the users from setting them during the create operation. This allows the default values (now() and autoId()) to prevail.
(I am not sure if the @auth rules are applied in the same way for transformer-v1 as it is in transformer-v2 so this may or may not be a relevant solution for v1.)


Fail to serializer PyTorch model as WXF

I am trying to convert some PyTorch models into WLNet models.
PyTorch models are generally saved as pth files.
A *.pth file is a collections.OrderedDict of torch.tensor, it looks like:
OrderedDict([
	('name.weights', tensor([64×3×3×3])),
	('name.biases', tensor([64])),
])

I expect them to be converted into the following results:
<|
	"name.weights" -> RawData[64×3×3×3],
	"name.biases" -> RawData[64]
|>

But I have encountered some problems, torch.tensor can not be converted.
import torch
import wolframclient.serializers as wxf
x = torch.tensor([[1, 2, 3], [4, 5, 6]])
print(x)
wxf.export(x, 'tensor.wxf', target_format='wxf')

Traceback (most recent call last):
File "<input>", line 1, in <module>
File "C:\Anaconda3\lib\wolframclient\serializers\__init__.py", line 60, in export data, stream=stream)
File "C:\Anaconda3\lib\wolframclient\serializers\base.py", line 22, in export self.dump(data, file)
File "C:\Anaconda3\lib\wolframclient\serializers\wxf.py", line 54, in dump for payload in self.normalize(data):
File "C:\Anaconda3\lib\wolframclient\utils\dispatch.py", line 96, in inner return self.resolve(function, *args)(obj, *args, **opts)
File "C:\Anaconda3\lib\wolframclient\serializers\normalizer\__init__.py", line 21, in normalizer return self.serialize_iterable(self.normalize(value) for value in o)
File "C:\Anaconda3\lib\wolframclient\serializers\base.py", line 72, in serialize_iterable self.serialize_symbol(b'List'), iterable, **opts)
File "C:\Anaconda3\lib\wolframclient\serializers\wxf.py", line 67, in serialize_function iterable, length = get_length(args, **opts)
File "C:\Anaconda3\lib\wolframclient\serializers\wxf.py", line 27, in get_length iterable = tuple(iterable)
File "C:\Anaconda3\lib\wolframclient\serializers\normalizer\__init__.py", line 21, in <genexpr> return self.serialize_iterable(self.normalize(value) for value in o)
File "C:\Anaconda3\lib\wolframclient\utils\dispatch.py", line 96, in inner return self.resolve(function, *args)(obj, *args, **opts)
File "C:\Anaconda3\lib\wolframclient\serializers\normalizer\__init__.py", line 21, in normalizer return self.serialize_iterable(self.normalize(value) for value in o)
File "C:\Anaconda3\lib\wolframclient\serializers\base.py", line 72, in serialize_iterable self.serialize_symbol(b'List'), iterable, **opts)
File "C:\Anaconda3\lib\wolframclient\serializers\wxf.py", line 67, in serialize_function iterable, length = get_length(args, **opts)
File "C:\Anaconda3\lib\wolframclient\serializers\wxf.py", line 27, in get_length iterable = tuple(iterable)
File "C:\Anaconda3\lib\wolframclient\serializers\normalizer\__init__.py", line 21, in <genexpr> return self.serialize_iterable(self.normalize(value) for value in o)
File "C:\Anaconda3\lib\wolframclient\utils\dispatch.py", line 96, in inner return self.resolve(function, *args)(obj, *args, **opts)
File "C:\Anaconda3\lib\wolframclient\serializers\normalizer\__init__.py", line 21, in normalizer return self.serialize_iterable(self.normalize(value) for value in o)
File "C:\Anaconda3\lib\torch\tensor.py", line 381, in __iter__ raise TypeError('iteration over a 0-d tensor')
TypeError: iteration over a 0-d tensor

But I think  torch.tensor just the same as numpy.ndarray.
How can I solve this problem.

I'm not an expert of Torch but the torch tensor method numpy() seems to do what you need:
wxf.export(x.numpy(), target_format='wxf')
Note that even though torch tensor and numpy array can share the underlying memory, they are not the same object.
The error you witness is raised by torch. The WXF serializer does not recognize torch tensor, but can serialize iterable objects, and torch tensors are iterable objects. When working on a matrix, first iteration targets rows, second targets 0 dimension tensor, i.e matrix elements wrapped into a tensor. Those are iterable, but it's an invalid operation which raises an error.
From your torsor x:
for row in x:
   for elem in row:
       print(elem, 'is iterable?', hasattr(elem, '__iter__'))

Nice, this works.
I think we can provide some pre-defined methods to convert some common files, such as *.pkl, *.npz etc.
This should be useful:
#!/usr/bin/env python
# coding=utf-8
import torch
import pickle
import numpy
import wolframclient.serializers as wxf

def pkl2wxf(path):
	file = open(path, 'rb')
	objs = []
	while True:
		try : objs.append(pickle.load(file))
		except EOFError : break
	file.close()
	print(objs)
	wxf.export(objs, path + '.wxf', target_format='wxf')

def npy2wxf(path):
	data = numpy.load(path)
	wxf.export(data, path + '.wxf', target_format='wxf')

def pth2wxf(path):
	pth = torch.load(path, map_location=torch.device('cpu'))
	npy = {key: value.numpy() for key, value in pth.items()}
	wxf.export(npy, path + '.wxf', target_format='wxf')

pth2wxf('checkpoint.pth')


http_log: include remote_port

When using an ALB, this makes it easier to correlate Nginx logs with ALB
logs.
cc @fancyremarker

Before:
<IP_ADDRESS> -/- <IP_ADDRESS> - [08/Jun/2017:11:38:45 +0000] "GET /.aptible/alb-healthcheck HTTP/1.1" 200 0 0.002 "-" "ELB-HealthChecker/2.0"
<IP_ADDRESS> TLSv1.2/ECDHE-RSA-AES256-GCM-SHA384 <IP_ADDRESS> - [08/Jun/2017:11:38:45 +0000] "GET /.aptible/alb-healthcheck HTTP/1.1" 200 0 0.000 "-" "ELB-HealthChecker/2.0"

After:
<IP_ADDRESS>:15918 -/- <IP_ADDRESS> - [08/Jun/2017:11:39:25 +0000] "GET /.aptible/alb-healthcheck HTTP/1.1" 200 0 0.002 "-" "ELB-HealthChecker/2.0"
<IP_ADDRESS>:9242 TLSv1.2/ECDHE-RSA-AES256-GCM-SHA384 <IP_ADDRESS> - [08/Jun/2017:11:39:25 +0000] "GET /.aptible/alb-healthcheck HTTP/1.1" 200 0 0.000 "-" "ELB-HealthChecker/2.0"


Dwarf DebugInfo for Vars

This is for local/parameter debugging for Unix

Generation dwarf debuginfo for vars: https://github.com/dotnet/corert/pull/5542 https://github.com/dotnet/corert/pull/5550 https://github.com/dotnet/corert/pull/5592


Add a new rule git_rebase_no_changes.

This rule fixes the case where you've run "git rebase --continue", as instructed by "git status", only to be rejected because there are no changes in the commit. The fix is rote; you run "git rebase --skip" instead of "git rebase --continue".

Coverage increased (+0.04%) to 91.235% when pulling 4bd4c0f731cf6e3e3d43253f51962c1d187ce3ad on TheJakeSchmidt:add-git_rebase_continue_no_changes into b8c5433dc474ff3ebe658623f5e0dc7d6c02d3ae on nvbn:master.

Thanks!
I've made a few changes.


Shutters and presence detector alarm not finded

Hello, I have installed and configured everything. I see lights, sensors, switch, scenes and alarm but I can't see shutters and presence detectors. Do you know why?
Thank you

Hi gianpelu.
About "presence detectors", do you mean the vedo IR sensor?
The shutters should work, do you have some logs?
You should see something like
[custom_components.comelit.hub] added the cover


Trigger not working with laravel-websockets

Hi there,
I'm trying to use this package to communicate with a laravel-websockets server.
I'm able to connect and subscribe to private and presence channels fine, if I send an event from the websockets dashboard the code receives it correctly.
However trigger does nothing, no errors but nothing shows in the dashboard and other clients subscribed to the same private channel receive nothing.
I'm testing on both iOS and web and get the same behavior on both.
Does this ring a bell?
Thanks!

Hello, could you send your minimal code sample and logs that displayed on terminal (or Debug console) by this package? Enable logs calling PusherChannelsPackageLogger.enableLogs()

And also ensure that the pusher protocol version of your laravel-websockets support triggering the events

@barees63  Also be careful with what you try to send in data. You must send either objects of primitive types only (int, String, bool) or collections that contain only primitives:
 // Good
 myPresenceChannel.trigger(
    eventName: 'client-event',
    data: {'hello': 'Hello'},
  );

// Bad. Will fail
myPresenceChannel.trigger(
    eventName: 'client-event',
    data: MyClass(),
  );

this is the send function:
Future<void> sendMessage({required ChatMessage message}) async {
    final name =
        'private-${min(message.fromUserId, message.toUserId)}-${max(message.fromUserId, message.toUserId)}';
    final channel = _channels[name];
    if (channel == null) {
      debugPrint('Channel not found');
      return;
    }
    channel.trigger(
      eventName: 'message',
      data: jsonEncode({'hello': 'world'}), //message.toJson(),
    );
    }

and the logs:
flutter: Current lifecycle state: PusherChannelsClientLifeCycleState.pendingConnection
flutter: Timer was canceled
flutter: Received an event: {"event":"pusher:connection_established","data":"{\"socket_id\":\"565175652.31687435\",\"activity_timeout\":30}"}
flutter: Timer was canceled
flutter: Timer is set to: 0:02:00.000000
flutter: Current lifecycle state: PusherChannelsClientLifeCycleState.establishedConnection
flutter: Subscribed to presence channel presence-104
flutter: Subscribed to presence channel presence-40275
flutter: Subscribed to presence channel presence-224347
flutter: Received an event: {"event":"pusher_internal:subscription_succeeded","channel":"presence-104","data":"{\"presence\":{\"ids\":[0],\"hash\":[[]],\"count\":1}}"}
flutter: Got an event, continuing activity
flutter: Timer was canceled
flutter: Timer is set to: 0:02:00.000000
flutter: PresenceCubit: {"presence":{"ids":[0],"hash":[[]],"count":1}}
flutter: Received an event: {"event":"pusher_internal:subscription_succeeded","channel":"presence-40275","data":"{\"presence\":{\"ids\":[0],\"hash\":[[]],\"count\":1}}"}
flutter: Got an event, continuing activity
flutter: Timer was canceled
flutter: Timer is set to: 0:02:00.000000
flutter: PresenceCubit: {"presence":{"ids":[0],"hash":[[]],"count":1}}
flutter: Received an event: {"event":"pusher_internal:subscription_succeeded","channel":"presence-224347","data":"{\"presence\":{\"ids\":[0],\"hash\":[[]],\"count\":1}}"}
flutter: Got an event, continuing activity
flutter: Timer was canceled
flutter: Timer is set to: 0:02:00.000000
flutter: PresenceCubit: {"presence":{"ids":[0],"hash":[[]],"count":1}}
flutter: subscribed private-40275-120709
flutter: Received an event: {"event":"pusher_internal:subscription_succeeded","channel":"private-40275-120709"}
flutter: Got an event, continuing activity
flutter: Timer was canceled
flutter: Timer is set to: 0:02:00.000000
flutter: Attempt to trigger: {"event":"message","channel":"private-40275-120709","data":"{\"hello\":\"world\"}"}

laravel websockets has client messaging (?)  enabled:
'apps' => [
        [
            'id' => env('PUSHER_APP_ID'),
            'name' => env('APP_NAME'),
            'key' => env('PUSHER_APP_KEY'),
            'secret' => env('PUSHER_APP_SECRET'),
            'path' => env('PUSHER_APP_PATH'),
            'capacity' => null,
            'enable_client_messages' => true,
            'enable_statistics' => true,
        ],
    ],

btw, if I pass a Map<String,dynamic> instead the encoded string it makes no difference.

And also ensure that the pusher protocol version of your laravel-websockets support triggering the events

is that just the enable_client_messages setting or something else?
Thanks!

btw, if I pass a Map<String,dynamic> instead the encoded string it makes no difference.
flutter: Attempt to trigger: {"event":"message","channel":"private-40275-120709","data":{"hello":"world"}}

And also ensure that the pusher protocol version of your laravel-websockets support triggering the events

is that just the enable_client_messages setting or something else?
Thanks!

I am not a server-side developer but there must be something missing on the server side. Maybe some filter blocks the client events. For example, maybe, client events with specific name can only be triggered. Try logging the messages that come to your server

ok, I'll keep battling :)
fwiw, the triggered message does make it to the server but it doesn't progagate, this is a log from laravel:
1194738: connection id 34846611.56071607 received message: {"event":"message","channel":"private-40275-120709","data":{"hello":"world"}}.

ok, I'll keep battling :)
fwiw, the triggered message does make it to the server but it doesn't progagate, this is a log from laravel:
1194738: connection id 34846611.56071607 received message: {"event":"message","channel":"private-40275-120709","data":{"hello":"world"}}.

So I'd say you're quite correct, back end issue.

If you make it through in backend - please, leave a comment with a solution. It may help others who will visit the issues. I will keep it open until you resolve it. Thank you in advance!

I will, and thank you for a very nice package, I always prefer pure dart.

so sorry to have bothered you with this!  It was just me.. I didn't realize I needed to prefix the event name with client- for client messaging.  It's now working perfectly, thanks.

@barees63 i'm having same problem. could you write how did you do on server side?
"beyondcode/laravel-websockets": "^1.13",
"pusher/pusher-php-server": "^7.0"


fix: trap function return recent exit code

Fixes: https://github.com/redkubes/otomi-core/issues/284
Fixes both: validate-templates.sh script and recently introduced bug in our template, which was not properly reported.

closing in favor of better solution delivered soon from conftest branch


Use the installation directory as the default working directory

For the distDocker task that is generated in the presence of the application plugin, consider setting the workingDir to the installation directory.   This would allow applications to use relative paths when referring to the conf directory, etc.
Here's a workaround, manually configure the distDocker task in build.gradle:
distDocker {
  def installDir = "/" + project.distTar.archiveName - ".${project.distTar.extension}"
  workingDir installDir
}

That´s an interesting idea. We highly welcome all contributions, if you issue an PR for we may take a look at it


Using daterangepicker without bootstrap

Hi Evan,
I'm working on Angular 5 with Material Design and would prefer to avoid using bootstrap, but when i remove the bootstrap css the datepicker doesn't behave as expected... Any suggestions?
Thanks!

The picker is a port of the popular bootstrap daterangepicker and currently we haven't added any extra features apart from making it work seamless in Angular.
I will look into removing the jquery and bootstrap dependencies but there's no set timeline at the moment.


Add wave trace capability to sim

Add one command line parameter: --trace to support write out the wave trace into a vcd format file, which is able to view by gtkwave.
Modify the Makefile to generate the trace by default when testing one individual test case. test_all kept unchanged and does not generate trace to save time and disk.

iverlog is still better as it will correct set x signal while verilator assume x to 0.

Thanks for your contribution!


Do we have training examples?

❓ Questions
Hi encodes team,
great job!

We want to reimplement the results and train a new model in a wider range of the sound dataset and add some denoise/dereverberation functionality. Could you please add some training examples?

Hi @adiyoss ,
Though I am not sure what @ChuxiJ was meant, I am also here voting for releasing the codes for training the encodec from scratch. Looking forward to it!

+1 It would be super nice to have this to understand how this architecture is trained from scratch 🚀 Thanks for your work guys!

+1 training code will be very helpful. thanks!

+1 I also think the training code is very helpful in understanding. Thanks.

+1 training code would be very helpful. Thanks for this amazing research!

+1 training code would be very helpful. Thanks for this amazing research!!!!

+1 training code would be very helpful. Thanks for this amazing research!!!!!!!

Anyone created a training script?

+1 training code would be very helpful. Thanks for this amazing research!!!!!!!

+1 training code would be super helpful!

found a decent implementation with training code here NoFish-528/encodec-pytorch: unofficial implementation of the High Fidelity Neural Audio Compression. hope it helps you guys.

found a decent implementation with training code here NoFish-528/encodec-pytorch: unofficial implementation of the High Fidelity Neural Audio Compression. hope it helps you guys.

hhhh, it's my pleasure. And I'm a new comer in audio, maybe there are some bugs. But do not hesitate to contact me if you have any things or questions want to discuss. And I hope we can get together to advances in the field.
In my code, I haven't add LM and Balancer, and I only train the 24khz model in LibriTTS 960h.

The info about unavailability of a training script should be added to the README.

+1
Any updates on releasing training code? Would be helpful for related research.. Reproducibility 😅


DNS Settings for 2 domain controllers in the same vNET

It would be good to get official guidance from Microsoft on the recommended set up when you have two domain controllers\DNS servers in the same VNET. This is a very normal design for Azure customers and is not properly addressed in any documentation. See the example below for further clarification. So the question is really, to replicate the on premises set up below, should the DNS settings for DC\DNS servers in Azure be set at the NIC level rather than the vNET level. If, so, it would be good tosee this called out in the doucmentation.
ON prem set up of DC\DNS servers
DC\DNS Server A
IP Address:                         <IP_ADDRESS>
Preferred DNS Server:     <IP_ADDRESS>
Alternative DNS Server:  <IP_ADDRESS>
DC\DNS Server B
IP Address:                         <IP_ADDRESS>
Preferred DNS Server:     <IP_ADDRESS>
Alternative DNS Server:  <IP_ADDRESS>
In Azure with Custom DNS Set at the vNET level
DNS: <IP_ADDRESS>
DNS: <IP_ADDRESS>
DC\DNS Server A
IP Address:                         <IP_ADDRESS>
Preferred DNS Server:     <IP_ADDRESS>
Alternative DNS Server:  <IP_ADDRESS>
DC\DNS Server B
IP Address:                         <IP_ADDRESS>
Preferred DNS Server:     <IP_ADDRESS>
Alternative DNS Server:  <IP_ADDRESS>

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 65f26361-0def-4ae9-e28a-8a8d4f97b87f
Version Independent ID: ef55eb02-6543-88ad-4f89-5a553848bc67
Content: Deploy AD DS in an Azure virtual network - Azure Architecture Center
Content Source: docs/reference-architectures/identity/adds-extend-domain.yml
Service: architecture-center
Sub-service: reference-architecture
GitHub Login: @martinekuan
Microsoft Alias: architectures

@KumudD / @BrianBlanchard for this content signal

@gerrynicol
I've delegated this to content author @martinekuan and @KumudD, who will review it and offer their insightful opinions.

@ckittel
Thank you for your Response.

@lukemurraynz has added content for this topic a while ago.  As such we are going to close the issue.
#please-close


Raise ValuationError if invalid date entered in DateInputField

Fix crash which occurs when invalid dates are compressed.

Cheers @ahernp and sorry for the delay!


chomsky_normal_form() for grammars

nltk.tree.Tree has a chomsky_normal_form() function, but grammars don't. Since CNF is a form of the grammar, it should, also.

The chomsky_normal_form() in NLTK is a tree-binarization function. I think it can't be directly applied to grammars, see https://github.com/nltk/nltk/blob/develop/nltk/treetransforms.py
Grammar transformation to CNF is rather complex and hasn't yet been implemented. It would be good if there's an attempt at it, but it might not be trival.
If anyone is interested in contributing, a good algorithm to start out is

Lange and Leiß (2009). "To CNF or not to CNF? An Efficient Yet Presentable Version of the CYK Algorithm"

I was looking around for exactly this and stumbled here,
I've created this functionality by exploiting nltk internals for one of my projects (and a CKY parser on top of it as well), would be happy to send a PR, just wanted to confirm if this issue still holds and is available to work on (especially after the last comments in https://github.com/nltk/nltk/issues/1722)
Also if there's no CYK parser as mentioned in the other issue, I'd be happy to send a PR for that as well

@virresh @alvations Sorry for letting #1722 get stale.  Life has gotten in the way.
@virresh If you'd like to take a wack at this be my guest.  I wrote a conversion to CNF years ago.
https://github.com/aetilley/pcfg/blob/master/src/pcfg.py#L524
I remember it reordering the steps in the usual algorithm but I also remember convincing myself that they were equivalent.  Proceed with caution.
I'm going to close the other issue.

There is a problem with CNFs for CFGs; they are returning duplicated productions. You can test this by:
import nltk
grammar = nltk.data.load("grammars/large_grammars/atis.cfg")
grammar = grammar.chomsky_normal_form()
print(len(grammar.productions()))
print(len(list(set(grammar.productions()))))

grammar has 20344 productions, which when converted to a set give 12396 productions.

I have just stumbled upon this thread. I have written my own version of the CFG.chomsky_normal_form() method because the one present was incomplete (cannot deal with empty productions, etc.). Mine works. Also simplifies the grammar if possible. I'd be happy to contribute it. I haven't contributed to NLTK before. How does this work?

@stefkauf Information on how to contribute can be found in CONTRIBUTING.md.


V100 gpu执行ollama的示例失败

(lightGraph) (base) root@ctmt240508091427u9e-7684c88f7-bl5wc:/mnt/home/ollama/LightRAG-main/examples# python lightrag_ollama_demo.py
INFO:lightrag:Logger initialized for working directory: ./dickens
INFO:lightrag:Load KV full_docs with 0 data
INFO:lightrag:Load KV text_chunks with 0 data
INFO:lightrag:Load KV llm_response_cache with 0 data
INFO:nano-vectordb:Init {'embedding_dim': 768, 'metric': 'cosine', 'storage_file': './dickens/vdb_entities.json'} 0 data
INFO:nano-vectordb:Init {'embedding_dim': 768, 'metric': 'cosine', 'storage_file': './dickens/vdb_relationships.json'} 0 data
INFO:nano-vectordb:Init {'embedding_dim': 768, 'metric': 'cosine', 'storage_file': './dickens/vdb_chunks.json'} 0 data
INFO:lightrag:[New Docs] inserting 1 docs
INFO:lightrag:Writing graph with 0 nodes, 0 edges
Traceback (most recent call last):
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/urllib3/connection.py", line 174, in _new_conn
conn = connection.create_connection(
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/urllib3/util/connection.py", line 95, in create_connection
raise err
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/urllib3/util/connection.py", line 85, in create_connection
sock.connect(sa)
TimeoutError: [Errno 110] Connection timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/urllib3/connectionpool.py", line 716, in urlopen
httplib_response = self._make_request(
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/urllib3/connectionpool.py", line 404, in _make_request
self._validate_conn(conn)
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/urllib3/connectionpool.py", line 1061, in _validate_conn
conn.connect()
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/urllib3/connection.py", line 363, in connect
self.sock = conn = self._new_conn()
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/urllib3/connection.py", line 186, in _new_conn
raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f7932c7d190>: Failed to establish a new connection: [Errno 110] Connection timed out
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/requests/adapters.py", line 667, in send
resp = conn.urlopen(
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/urllib3/connectionpool.py", line 802, in urlopen
retries = retries.increment(
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/urllib3/util/retry.py", line 594, in increment
raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='openaipublic.blob.core.windows.net', port=443): Max retries exceeded with url: /encodings/o200k_base.tiktoken (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f7932c7d190>: Failed to establish a new connection: [Errno 110] Connection timed out'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/mnt/home/ollama/LightRAG-main/examples/lightrag_ollama_demo.py", line 31, in
rag.insert(f.read())
File "/mnt/home/ollama/LightRAG-main/examples/lightrag/lightrag.py", line 196, in insert
return loop.run_until_complete(self.ainsert(string_or_strings))
File "/root/anaconda3/lib/python3.9/asyncio/base_events.py", line 647, in run_until_complete
return future.result()
File "/mnt/home/ollama/LightRAG-main/examples/lightrag/lightrag.py", line 221, in ainsert
for dp in chunking_by_token_size(
File "/mnt/home/ollama/LightRAG-main/examples/lightrag/operate.py", line 33, in chunking_by_token_size
tokens = encode_string_by_tiktoken(content, model_name=tiktoken_model)
File "/mnt/home/ollama/LightRAG-main/examples/lightrag/utils.py", line 123, in encode_string_by_tiktoken
ENCODER = tiktoken.encoding_for_model(model_name)
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/tiktoken/model.py", line 103, in encoding_for_model
return get_encoding(encoding_name_for_model(model_name))
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/tiktoken/registry.py", line 73, in get_encoding
enc = Encoding(**constructor())
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/tiktoken_ext/openai_public.py", line 92, in o200k_base
mergeable_ranks = load_tiktoken_bpe(
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/tiktoken/load.py", line 147, in load_tiktoken_bpe
contents = read_file_cached(tiktoken_bpe_file, expected_hash)
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/tiktoken/load.py", line 64, in read_file_cached
contents = read_file(blobpath)
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/tiktoken/load.py", line 25, in read_file
resp = requests.get(blobpath)
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "/mnt/home/ollama/lightGraph/lib/python3.9/site-packages/requests/adapters.py", line 700, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='openaipublic.blob.core.windows.net', port=443): Max retries exceeded with url: /encodings/o200k_base.tiktoken (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f7932c7d190>: Failed to establish a new connection: [Errno 110] Connection timed out'))

脚本文件内容：![image](https://github.com/user-attachments/assets/05cff714-403b-44db-8d87-63f8d2cd7ccc
本地ollma相关模型已经都有：

由于是内网机器需要下载这个么？

我看报错内容是openai的通讯问题，怀疑是代码中仍然存在openai调用


Create test.yaml

Starting github-check jobs.

Build failed.

linters https://sftests.com/logs/7bc2f9869ca147048dceaa5e10852897/ : FAILURE in 5s

Starting github-check jobs.

Build failed.

linters https://sftests.com/logs/1c5b89ab246b4cf6896484aa3287b624/ : FAILURE in 5s


Dancing handler for colors button

We have three button for our three colors in demo preview so we need a button handler for every one of them.

[x] Attach a handler to every button in color section.

[x] Getting values from the inputs in the color section.

[x] Assign the values to option object.

[x] Calling dance method of coda with 'body' and the option from pre step.

This issue solved


DF-505: Hide available to download for closed records, show closure status

Ticket URL: https://national-archives.atlassian.net/browse/DF-505
About these changes

Changes to hide view download for closed records in search
Added Closure status to record details page

How to check these changes

search

Navigate to Online records at the National Archives
View results for Closed and Open records - see Image icon hidden for Closed records

record details page

Navigate to record details page
View a new Closure status field added (will appear only if present in the API)

Before assigning to reviewer, please make sure you have

[x] Checked things thoroughly before handing over to reviewer.
[x] Checked PR title starts with ticket number as per project conventions to help us keep track of changes.
[x] Ensured that PR includes only commits relevant to the ticket.
[x] Waited for all CI jobs to pass before requesting a review.
[x] Added/updated tests and documentation where relevant.

Merging PR guidance
Follow docs\developer-guide\contributing.md
Deployment guidance
Follow docs\infra\environments.md

This PR is closed to avoid merge conflicts due dependent changes of https://github.com/nationalarchives/ds-wagtail/pull/1058 and upcoming changes following the new PR
New changes for this new PR is with https://github.com/nationalarchives/ds-wagtail/pull/1183


Cap size of RPT in keycloak

Move of repo from almighty --> fabric8-services
Latest changes incl. RPT token limits https://github.com/fabric8-services/keycloak/pull/90
take commit https://github.com/fabric8io/keycloak-deployment/commit/15751c889f5099504cfa7256183f59a59a3ef624

@hectorj2f we need to make sure we are good in terms of cluster/standalone mode in prod.


clarify namespace

have pity on the poor people using search engines.

@donbright Still interested in getting this merged?

@donbright Ping!

Closing due to inactivity.


fix: Unnecessary render

Codecov Report

Merging #1349 (7091969) into master (7bc39a8) will decrease coverage by 14.58%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master   #1349       +/-   ##
==========================================
- Coverage   23.87%   9.29%   -14.59%
==========================================
  Files         198     118       -80
  Lines       14675   11848     -2827
  Branches       99       0       -99
==========================================
- Hits         3504    1101     -2403
+ Misses      10939   10625      -314
+ Partials      232     122      -110

Flag
Coverage Δ

be_integration_test_nightly
?

be_unit_test
?

e2e_test
?

Flags with carried forward coverage won't be shown. Click here to find out more.

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7bc39a8...7091969. Read the comment docs.


Creation of service bus action is failing in both VSCode and standard portal

Describe the Bug with repro steps
1.Create a new Logic App Project

Add a workflow to your local project
Open the workflow.json file in designer and author a new workflow

a. Add http request Trigger
b. Add a compose action here with custom text
c. Add a ServiceBus action. From the add new paramter dropdown add content and add random text in JSON format like {"a":"b"}

What type of Logic App Is this happening in?
Standard (VSCode)
Are you using new designer or old designer
New Designer
Did you refer to the TSG before filing this issue? https://aka.ms/lauxtsg
Yes
Workflow JSON
{
    "definition": {
        "$schema": "https://schema.management.azure.com/providers/Microsoft.Logic/schemas/2016-06-01/workflowdefinition.json#",
        "actions": {
            "Compose": {
                "type": "Compose",
                "inputs": "frtgy",
                "runAfter": {}
            }
        },
        "contentVersion": "<IP_ADDRESS>",
        "outputs": {},
        "triggers": {
            "When_a_HTTP_request_is_received": {
                "type": "Request",
                "kind": "Http"
            }
        }
    },
    "kind": "Stateful"
}

Screenshots or Videos
No response
Browser
Microsoft Edge
Additional context

Hi @ramya894, this will be fixed with the following PR: https://github.com/Azure/LogicAppsUX/pull/4265


echeckCredit XML Requst/Response

For void and other vantiv calls, I can see the request/response XML from those requests here: https://github.com/Vantiv/litle-sdk-for-java/blob/6f4ff6835bc16169ceeb27b73b5cf06f5ed48c07/src/main/java/com/litle/sdk/Communication.java#L128
Is there a way on how to see the XML request/responses when doing an echeckCredit ?

System.out.println("Response: " + response.getResponse()); from https://gist.github.com/VantivSDK/2139831.js I just need the request that is being sent to the server.

Hi @neoadventist,
The echeckCredit transaction should go through the same println logic as the other transactions, are you not seeing this transaction type being printed to the console?

@brianarnold789 I am not, let me verify this again tomorrow and I will get back to you.


fix inline code bug

Background
This fixes a mismatch where checkout UI extensions must be generated with version 0.10.13 and admin UI must be generated with 0.10.10 otherwise code within accordions don't show correctly.
This updates the @shopify/generate-docs package to a known stable release version of 0.10.13 that checkout UI extensions has been using for some time. This fixes a previous issue where code within an accordion would be inlined as opposed to using a code file.
Solution
Use files for code examples as intended and bump the version to 0.10.13 where this was fixed.
🎩

...

Checklist

[ ] I have :tophat:'d these changes
[ ] I have updated relevant documentation

Closed in favor of https://github.com/Shopify/ui-extensions/pull/1395


Avoid verbose default logs

Motivation
Zebra's default logs should support a typical workflow:

Developer or user runs Zebra with the default config
They send the logs to a terminal
When they see a bug, they copy-paste the last few log lines into a bug report

Solution
Temporarily downgrade a verbose info-level log to debug level.
After this change:

more important warnings and errors will be visible in the terminal
copying and pasting recent logs will capture more important log messages
we won't have an info-level progress report for every block

Create follow up tasks to design better progress reports and log levels in #1380 and #1381.
Review
@hdevalence should review this change because he made the original change.
Related Issues
This log level has been:

changed from debug to info in #1348
changed from info to debug in #1373
changed from debug to info in #1375

@hdevalence and I have discussed this change. We agreed on a debug-level log as a temporary solution. I opened tickets #1380 and #1381 to come up with a permanent solution.
Follow Up Work
We'll provide regular progress reports in zebrad's logs in #1380.
We'll create a consistent logging design for Zebra in ticket #1381.

👍


Add config file with path and classname options - Fixes #192

Fixes #192 by adding config file for paths for Livewire views, javascript assets and class namespaces.
Currently, Livewire hardcodes the applications root namespace, and view path. This change allows for configuration of those values to be pulled from .env, to be set statically in the config file, or retain the existing defaults. Includes a third configuration value to set the js asset "base_url"
(Do over from yesterday when I had no business sitting at a keyboard! :honeybee:)

Thanks @defenestrator, where is the config file stub though? Am I missing something? I loved that you had proper Taylor Otwell comments.

Oh, lol - nvm

About fifty percent of the time I make a new directory I fail to git add it, lately - new workflows are new, and I'm rusty, thanks.

Maybe this PR could also default to Application::getNamespace() in case the config file doesn't exist?

Maybe this PR could also default to Application::getNamespace() in case the config file doesn't exist?

The config file feels like the wrong place to do it, in terms of conventions, any preferences about that? New class or...I haven’t read enough of the source to know where to stick it yet. I will get back to this tomorrow.

That wouldn’t actually work I believe. Sorry I should have been more specific.
The config() helper accepts a default value as the 2nd parameter 👌🏻

Of course it does, and somehow I have never used it, thanks @tillkruss

php artisan vendor:publish --tag=livewire-config

I have other improvements to make and some tests to add, but got caught up in other stuff yesterday.
I can throw those over the wall today.

This is approximately good to go. I do want to add some new tests, but in looking into that I learned some refactoring of the existing tests might be wise, and probably needs a separate issue and PR.

I'll get back to this in a bit @calebporzio life happened and now I'm making dumb mistakes - thanks for the feedback.

Sorry, a tree fell on my house Sunday, I will get back and finish this...today? Soon as possible.

Hey @defenestrator, that's crazy - sorry about your house. I'm actually heading out of town for a week, so I'll get back to this when I get back. Thanks!

I want this in, so I'm going to just merge this and make some of the changes myself. Thanks a ton for the work on this @defenestrator!!

I feel awful about this PR. I had to replace the roof on my house myself
and then my girlfriend and I both came down with freaking Listeria! Almost
a month later and we’re barely feeling human again. Home ownership is an
odyssey. Cheers to the Livewire team, I hope to make real use of it soon.
On Wed, Sep 18, 2019 at 14:08 Caleb Porzio<EMAIL_ADDRESS>wrote:

Merged #235 https://github.com/calebporzio/livewire/pull/235 into
master.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/calebporzio/livewire/pull/235?email_source=notifications&email_token=AAEBIJWLPMZIJZJRCPWDG6DQKKDFVA5CNFSM4ITJJ752YY3PNVWWK3TUL52HS4DFWZEXG43VMVCXMZLOORHG65DJMZUWGYLUNFXW5KTDN5WW2ZLOORPWSZGOTWSD7BY#event-2644787079,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAEBIJTM4VM3337CIEBHMX3QKKDFVANCNFSM4ITJJ75Q
.

--
With my warm regard,
Jeremy Anderson
📱1.208.283.8654

via mobile

@all-contributors please add @defenestrator for code


filter pruning error

Hi Neta,
I met a an error when doing filter pruning, after debugging, I found it might because Distiller does not support concatenate operation.
The related layers of my network:
(aspp): ASPP_module(
(aspp0): Sequential(
(0): Conv2d(116, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)
(1): BatchNorm2d(256, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
)
(aspp1): Sequential(
(0): Conv2d(116, 256, kernel_size=(3, 3), stride=(1, 1), padding=(6, 6), dilation=(6, 6), bias=False)
(1): BatchNorm2d(256, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
)
(aspp2): Sequential(
(0): Conv2d(116, 256, kernel_size=(3, 3), stride=(1, 1), padding=(12, 12), dilation=(12, 12), bias=False)
(1): BatchNorm2d(256, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
)
(aspp3): Sequential(
(0): Conv2d(116, 256, kernel_size=(3, 3), stride=(1, 1), padding=(18, 18), dilation=(18, 18), bias=False)
(1): BatchNorm2d(256, eps=1e-05, momentum=0.1, affine=True, track_running_stats=True)
)
)
(global_avg_pool): Sequential(
(0): AdaptiveAvgPool2d(output_size=(1, 1))
(1): Conv2d(116, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)
)
(conv): Conv2d(1280, 256, kernel_size=(1, 1), stride=(1, 1), bias=False)
where input of layer 'conv' is concatenating outputs of aspp0. aspp1. aspp2, aspp3 and global_avg_pool (at dim = 1)
my configuration for pruning:
        module.aspp.aspp0.0.weight: [0.5, '3D']
        module.aspp.aspp1.0.weight: [0.5, '3D']
        module.aspp.aspp2.0.weight: [0.5, '3D']
        module.aspp.aspp3.0.weight: [0.5, '3D']
        module.global_avg_pool.1.weight: [0.5, '3D']

Then it is supposed that Distiller should prune the following layer 'conv' to be Conv2d(640, 256, kernel_size=(1, 1), stride=(1, 1), bias=False), but I got error ' Given groups=1, weight of size [256, 128, 1, 1], expected input[8, 640, 60, 80] to have 128 channels, but got 640 channels instead', which means Distiller does not recognise the concatenated inputs.
Please advise, thanks.

Hi @cattpku,
You probably missed issue #85, but I think that what you are seeing is this same bug.
If you can, please try using branch https://github.com/NervanaSystems/distiller/tree/issue_85 which fixes this issue (for filters; channels-pruning is WiP).
As issue #85 explains, some networks have complicated data-dependencies which means that we can't arbitrarily prune filters, but we have to group them so that they all follow the same pruning decision.  I realize this is somewhat hard to follow w/o more details so I plan to write and post a loner explanation in a couple of days.
Until then, you can create a PNG graph of your model and I can use it to illustrate to you the dependencies and how to express them.
Another option: take a look at this example, specifically at low_pruner_2.
I hope this helps for now,
Neta

Thanks for your kind explanation, Neta. I will try the branch later.

Hi Neta,
I tried to use the recommended branch, but the error is still there and exactly the same.

@cattpku - any chance you can provide more information?  For example, the model definition and your YAML schedule file can help me understand, and hopefully recreate what you are seeing.
Thanks

Hi Neta,
Sure. It is a DeepLabV3+ structure, definition is here:
`
class ASPP_module(nn.Module):
def init(self, inplanes, planes):
super(ASPP_module, self).init()
    self.aspp0 = nn.Sequential(nn.Conv2d(inplanes, planes, kernel_size=1,
                                         stride=1, padding=0, dilation=1, bias=False),
                               nn.BatchNorm2d(planes))
    self.aspp1 = nn.Sequential(nn.Conv2d(inplanes, planes, kernel_size=3,
                                         stride=1, padding=6, dilation=6, bias=False),
                               nn.BatchNorm2d(planes))
    self.aspp2 = nn.Sequential(nn.Conv2d(inplanes, planes, kernel_size=3,
                                         stride=1, padding=12, dilation=12, bias=False),
                               nn.BatchNorm2d(planes))
    self.aspp3 = nn.Sequential(nn.Conv2d(inplanes, planes, kernel_size=3,
                                         stride=1, padding=18, dilation=18, bias=False),
                               nn.BatchNorm2d(planes))

def forward(self, x):
    #print(x.size())
    x0 = self.aspp0(x)
    x1 = self.aspp1(x)
    x2 = self.aspp2(x)
    x3 = self.aspp3(x)

    return torch.cat((x0, x1, x2, x3), dim=1)

class DeepLab_v3_plus(nn.Module):
def init(self, nInputChannels=3, n_classes=2):
super(DeepLab_v3_plus, self).init()
# wrapped feature
self.wrapped_features = wrapper(1)
# ASPP
self.aspp = ASPP_module(stage_out_channels[2], 256)
# global pooling
self.global_avg_pool = nn.Sequential(nn.AdaptiveAvgPool2d((1, 1)),
nn.Conv2d(stage_out_channels[2], 256, 1, stride=1, bias=False))
self.conv = nn.Conv2d(1280, 256, 1, bias=False)
self.bn = nn.BatchNorm2d(256)
self.upsample_size = nn.Upsample(size = (60, 80),mode = 'bilinear', align_corners=None)
self.upsample = nn.Upsample(scale_factor=2, mode = 'bilinear', align_corners=None)
self.upsample_4 = nn.Upsample(scale_factor=4, mode = 'bilinear', align_corners=None)
self.last_conv = nn.Sequential(nn.Conv2d(256, n_classes, kernel_size=1, stride=1))
def forward(self, x):

    x = self.wrapped_features(x)
    x_aspp = self.aspp(x)
    x_ = self.global_avg_pool(x)
    x_ = self.upsample_size(x_)
    x_concat = torch.cat((x_aspp, x_), dim=1)
    x = self.conv(x_concat)
    x = self.bn(x)
    x = self.upsample(x)
    x = self.last_conv(x)
    x = self.upsample_4(x)

    return x

`
And the YAML schedule is
version: 1
pruners:
filter_pruner_50:
class: 'L1RankedStructureParameterPruner'
group_type: Filters
desired_sparsity: 0.5
weights: [
module.aspp.aspp0.0.weight,
module.aspp.aspp1.0.weight,
module.aspp.aspp2.0.weight,
module.aspp.aspp3.0.weight,
module.global_avg_pool.1.weight]
extensions:
net_thinner:
class: 'FilterRemover'
thinning_func_str: remove_filters
arch: 'DeepLab_v3_plus'
dataset: 'my_own_data'
policies:

pruner:
instance_name: filter_pruner_50
epochs: [46]

extension:
instance_name: net_thinner
epochs: [46]

The error comes from
 x_concat = torch.cat((x_aspp, x_), dim=1)         x = self.conv(x_concat)
I tried to manually modify 'module.conv' in 'thinning.py' by clearing the 'module.conv.weight', and then using 'append_module_directive' and 'append_param_directive' to assign the correct value, now my own experiment succeeded.

Hi @cattpku
"I tried to manually modify 'module.conv' in 'thinning.py' by clearing the 'module.conv.weight', and then using 'append_module_directive' and 'append_param_directive' to assign the correct value, now my own experiment succeeded." ==> can you share the fix?
I tried creating an environment for running DeepLab, but this is taking me too much time.
Thanks!
Neta

Sure.
All modifications are in 'def create_thinning_recipe_filters(sgraph, model, zeros_mask_dict):'
Firstly, I use 5 new variables to store the 'indices' of the 5 targeting layers (which are specified in my network definition above) before 'for successor in successors:':
`
if layer_name == 'module.aspp.aspp0.0':
indices_aspp0 = indices
    elif layer_name == 'module.aspp.aspp1.0':
        indices_aspp1 = torch.add(indices, 128)

    elif layer_name == 'module.aspp.aspp2.0':
        indices_aspp2 = torch.add(indices, 256)

    elif layer_name == 'module.aspp.aspp3.0':
        indices_aspp3 = torch.add(indices, 384)

    elif layer_name == 'module.global_avg_pool.1':
        indices_pool = torch.add(indices, 512)

`
Then before 'return thinning_recipe', I manually modify the 'module.conv' as following:
`
thinning_recipe.parameters['module.conv.weight'].clear()
append_module_directive(model, thinning_recipe, 'module.conv', key='in_channels', val=640)

append_param_directive(thinning_recipe, 'module.conv.weight', (1, torch.cat((indices_aspp0,  indices_aspp1,  indices_aspp2,  indices_aspp3,  indices_pool), 0)))

`
From my current experiment result, it seems worked for me.


Add rootstock trezor config

Description

This PR adds trezor configuration for the rootstock network.
This PR also fixes a bug while signing the transactions using trezor by replacing this line

 const rv = BigInt(result.payload.v.replace("0x", "")); // This line gives error: Uncaught SyntaxError: Cannot convert 5f to a BigInt
 Reason: Consider v = '0x5f'. The replace is removing 0x and then BigInt does not understand 5f as a hex value because 0x prefix is missing.

 Fixed it by using parseInt function.
 const rv = BigInt(parseInt(result.payload.v, 16));

Testing:

After applying these changes this PR is tested with both ethereum and rootstock networks using trezor
Works fine with both networks

Credits @alepc253
cc: @kvhnuke for review.

@ahsan-javaiid thanks for the bug fix as well!


A possible bug for Text2D

In the pos method of Text2D:
        if isinstance(pos, str): # corners
            ajustify = pos
            if "top" in pos:
                if "left" in pos:
                    pos = (0.008, 0.994)
                elif "right" in pos:
                    pos = (0.994, 0.994)
                elif "mid" in pos or "cent" in pos:
                    pos = (0.5, 0.994)
            elif "bottom" in pos:
                if "left" in pos:
                    pos = (0.008, 0.008)
                elif "right" in pos:
                    pos = (0.994, 0.008)
                elif "mid" in pos or "cent" in pos:
                    pos = (0.5, 0.008)
            else:
                printc("Text2D(): cannot understand pos:", pos, c='r')
                pos = (0.008, 0.994)
                ajustify = "top-left"

If the pos is middle-left, the above code will output cannot understand pos.
Is this a bug?

indeed it's not implemented.. while fixing it you can still do it with relative window coordinates, eg.:
t = Text2D("something", pos=(0.05,0.5), justify="bottom-left", s=7, bg='red', alpha=0.6)


TX Packets dropped on flannel.1

Hi,
we are running a 14 node k8s cluster with flannel (backend: vxlan) and we are seeing some packet drops on the flannel.1 interface:
        TX packets 416348507  bytes<PHONE_NUMBER>51 (638.5 GiB)
        TX errors 0  dropped 402 overruns 0  carrier 0  collisions 0

Under normal load (cpu about 20%) we are seeing 0.01pps getting dropped. If we are running some high traffic tests with iperf the dropping rate increases up to 1pps.
We are seeing this behaviour also on smaller clusters with only 3 oder 5 nodes.
Your Environment

Flannel version: 0.10.0
Backend used (e.g. vxlan or udp): vxlan
Etcd version: 3.2.15
Kubernetes version (if used): 1.10.2
Operating System and version: centos7.5

Have same issue on debian 9 with kernel 4.9.110-3+deb9u5

same issue

@discostur @andyzasl
find this post: https://tech.xing.com/a-reason-for-unexplained-connection-timeouts-on-kubernetes-docker-abd041cf7e02

it seems I have a bigger issues here
ifconfig flannel.1 flannel.1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1450         inet <IP_ADDRESS>  netmask <IP_ADDRESS>  broadcast <IP_ADDRESS>         inet6 fe80::b8ac:efff:fef7:2bfa  prefixlen 64  scopeid 0x20<link>         ether ba:ac:ef:f7:2b:fa  txqueuelen 0  (Ethernet)         RX packets<PHONE_NUMBER>  bytes<PHONE_NUMBER>594 (3.2 TiB)         RX errors 0  dropped 0  overruns 0  frame 0         TX packets<PHONE_NUMBER>  bytes<PHONE_NUMBER>763 (4.4 TiB)         TX errors 19  dropped 86146 overruns 0  carrier 19  collisions 0
Host centos7.4 and  what is the proper way to debug this issue?

we switched to backend type "DirectRouting" and since then, we don't see any packet drops; We didn't have time to check if @willmao solution is working for us ...
https://github.com/coreos/flannel/blob/master/Documentation/backends.md


fix bob effect

0001-fix-bob-effect.patch

Please submit your update as a pull request through the github system, links not accepted


WriteUp unavailable

shot by farine ???

if put write up online... You go to jail!!

Put it backkk !!


Subsample Large DFs to Create Charts

Summary
Rather than use the whole dataset, this PR takes a subsample of 10,000 observations from the data to build the charts. This expedites the chart creation process without dramatically hurting the visual information conveyed by any chart.
Note the more uneven the frequencies in a categorical column, the higher the probability of inaccurate representation. It might be good to add a warning about that somewhere.
Tests
Ran the unittest suite.
cc:
@tommydangerous

👀

@ChadGueli Thanks for your PR! We currently already sample 100k rows for data analysis and charts: https://github.com/mage-ai/mage-ai/blob/master/mage_ai/init.py#L83-L89
Do you have any particular reasons to further sample it down to 10k rows?

@wangxiaoyou1993 I was unaware that this sampling was already taking place. I think that 100k is probably better in the general setting particularly because that recommendations are based on the subsample.


Figlet in server

how to push to heroku figlet bot to discord, i have  error to the hour of execute this

This is not the place to ask this. Try using stackoverflow to ask questions.


Add onLoad attribute to <link> tag

This PR is to address the issue of absence of onLoad attribute on <link> tags.
The code changes involve adding new tag property, onload,  to HelmetConstants.js
This allows the ability to add the following variations of <link> tags.
<div>
  <Helmet>
     {/* link elements */}
      <link onLoad="doSomethingInteresting()" rel="stylesheet" media="all" type="text/css" href="critical-style.css" />
      <link onLoad="if(media!='all')media='all'" rel="stylesheet" media="none" type="text/css" href="non-critical-style.css" />
  </Helmet>
</div>

Two new tests have also been added to both declarative API. They test the rendered output of the tag elements.

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.Kesava Mallela seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.

Please merge this ! Highly needed when used in combination with react-static !

Any word on releasing this update? It would be nice to use this for loading of stylesheets like in @kesava 's example.

I’m also looking for the ability to use onLoad and onError on <link /> elements. @kesava This looks great. Also looks like the license/cla check is reporting that you haven’t yet signed the CLA. Maybe doing so could help this excellent PR get merged and released?

This seems to be stuck because of the License Agreement, can you comment @kesava? This feature would really help out a few of our teams as well.

@kesava @potench Any news about this PR?
Will script tags be support onLoad too?

@acusti @Grmiade @potench fixed the CLA agreement issue and the commit now passes all the tests.

Let's go !

When is this getting merged...?

Hey, great PR, would be really handy. Any news on this? @cwelch5, maybe?

@kesava can you merge master into your PR? I'll have some time this week to review.

We also have this issue, @kesava could you merge this?

@tmbtech can we merge this 🙏 Blocked on this issue and without this PR I'm going to need a pretty nasty workaround.

+1, why don't merged? How can we handle load events on Helmet-wrapped scripts?

Hello, Is there anything I can help with to get this merged

Thank you @sgnl, if you could merge with master and resolve the conflicts, I can work to get this merged this week.

@sgnl @cwelch5 Is there any word on when this will be merged / released? Thanks 👍

I'll focus on this after updating the dependencies.

➕ 1⃣  Please merge this! We would really like to use this feature to improve percieved performance on our website.

So.. I should give up on this library and look for other script-handling libraries since this 4-file change has been open for 5 years now, right?

So.. I should give up on this library and look for other script-handling libraries since this 4-file change has been open for 5 years now, right?

Looks like it.
I just checked and react-helmet-async, a fork which had some improvements, hasn't had a release for 4 years either.


[WIP] Add docker image build task

Add docker support to luigi tasks
Motivation and Context
As far as I have seen, currently, the only way to run tasks in docker container or build images is to implement it your way.
I think it would be nice to add a native support of such a feature.
Currently, a very first idea is to add a task to build a docker image.
Then, inspired on ssh module, remote file system and task run will be added if the suggestion is encouraged
Have you tested this? If so, how?
There is currently an example running it.
I will be happy to add unittests as soon as the feature suggestion is encouraged

This sure looks exciting. As anything with docker these days. ^^
I haven't done much docker myself, but there's been any questions about it on the mailing list. As you said the only way to do docker in luigi is to roll your own and it's tempting to at least offer some ready-made implementation, like the one in this PR. May I just suggest that you also send a mail to the mailing list and asking for other docker-enthusiasts to express their thoughts and opinions in this PR?

Since I don't see a thread on the mailing list, I'll weigh in briefly with my own docker-user thoughts here. I agree this looks like an exciting start. I can see a build image Task being useful. I would also like to see a way to invoke docker run, ideally with parameters to pass a command and mount volumes to the resulting container. This would allow for creation execution of task processes that are themselves containerized.
A standard, official Dockerfile for Luigi would probably be a good idea as well, and an aid to accomplishing my other suggestions. I see there a couple of GitHub projects for Luigi on Docker, but the ones I've found are based on phusion/baseimage which seems heavier than necessary to me. I've been running Luigi in a small alpine-based container for over a year now (the Docker Hub library of official images are all moving to alpine), and could contribute something along these lines if there is interest. It is possible to include an s6 supervisor in alpine, if something like the baseimage approach seems necessary. I generally do without it myself, and just use luigid as my container command directive.

@tym-oao yes, the idea is to provide a full support of docker containers inside luigi.
Including tasks being ran in docker run
I'm very pleased to see the interest this PR creates and will go on working on it

To run an arbitrary task containerized, one can already build an image that packages Luigi together with the task code and dependencies, and run that image.
Building images is usually part of deployment process, for which dedicated build tools are used; I suspect that this would be Luigi reinventing the wheel in that area...

@ulzha

-Building images is usually part of deployment process

I think the key word here is "usually". What I am hoping to achieve for batch jobs in general is that each would come up in a container (based on some standard image or set of images) with the job invocation as the CMD, so that the container would stop itself once the job ended. I can see doing this now for a Luigi workflow (in fact, I am very close to doing this now already, and I know many already do). What I think a Luigi docker task would offer is the ability to do the same sort of thing at the individual Task level, and have all of Luigi's strengths in managing that containerized dependencies, as we enjoy having it do for any other sort of task. Each containerized Task might itself invoke a luigi command line job, or (of course) any other sort of desired processing from outside Luigi, including programs in other languages. I suppose even the sort of thing I'm describing now could already be done, using docker-py and some logic in a run() call, but like @tjamet said at the beginning, it seems like it would be nice to have a contrib module to handle that in a standard, idiomatically Luigi-ish way, so we don't all each have to roll our own.

Thanks all for your feedback, will update the PR with more docker support soon

[Current coverage][cc-pull] is 74.96%

Merging [#1695][cc-pull] into [master][cc-base-branch] will decrease coverage by 3.82%

@@             master      #1695   diff @@
==========================================
  Files            94         97     +3
  Lines         10300      10428   +128
  Methods           0          0
  Messages          0          0
  Branches          0          0
==========================================
- Hits           8115       7817   -298
- Misses         2185       2611   +426
  Partials          0          0

Powered by Codecov. Last updated by [61c7f72...39da2f5][cc-compare]
[cc-base-branch]: https://codecov.io/gh/spotify/luigi/branch/master?src=pr
[cc-compare]: https://codecov.io/gh/spotify/luigi/compare/61c7f72f61d2cb575c6a07d977876f9510afe556...39da2f5480047cd1de3f8b547113659df3c091ea
[cc-pull]: https://codecov.io/gh/spotify/luigi/pull/1695?src=pr


Cannot install with PYTHONOPTIMIZE=2

Steps to reproduce:
$ docker run -e PYTHONOPTIMIZE=2 -it --rm python:2-alpine pip install pydot
Collecting pydot
  Downloading pydot-1.2.3.tar.gz
    Complete output from command python setup.py egg_info:
    pydot.py:33: UserWarning: Couldn't import dot_parser, loading of dot files will not be possible.
      "Couldn't import dot_parser, "
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-build-eqA_Ct/pydot/setup.py", line 32, in <module>
        long_description="\n".join(pydot.__doc__.split('\n')),
    AttributeError: 'NoneType' object has no attribute 'split'

    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-eqA_Ct/pydot/

When using PYTHONOPTIMIZE=2, __doc__ are removed from the generated *.pyo files, assuming that in a production deployment you never need the docstrings.
Could you please use an alternative method to get that docstring and make it work with maximum optimization?
Thanks!

Thank you for noting this behavior. The plan is to load the long description from the README file, so it should address this problem by not accessing a module docstring. However, there are situations (not necessarily within pydot) where docstrings are necessary, for example for parser generators that use ply.

But do you mean in a production environment?

To be more accurate, ply reads production rules defined within docstrings and produces a parser. It can save parser tables for later use, as an optimization. I am not sure whether ply can be configured to use those tables directly, without the code that defines the production rules.
In any case, ply is not used here (it could be in the future, if pyparsing was replaced, see https://github.com/erocarrera/pydot/issues/132#issuecomment-250311252). I mentioned this case to suggest that there are use cases where docstrings would have a function within a production environment.

Oh of course they have. That's why we have PYTHONOPTIMIZE=1 too 😉.
It's just that, if is it possible to optimize a little bit more, then it's indeed desirable. And otherwise, it would be good to document that.

Addressed by 526f1386eeb253c8d581a2ddb4c1f3602cd50d30, f374f66b93ec7e6bb7a6812abdb2d8a62db879f8.


changes for building local planner with catkin build

When building the local_planner with catkin build, the installation fails and throws out the following error:
CMake Error at cmake_install.cmake:118 (file):
  file INSTALL cannot find
  "<>/catkin_ws/devel/.private/local_planner/include/local_planner/local_planner_nodeConfig.h".

make: *** [install] Error 1

Changes to the cfg file fixes that.
After changing the cfg file, the launch files are not automatically installed, changes to the CMakeLists.txt file fixes that.

Hi, what command are you using to build the local_planner? catkin build local_planner works for me on master.
With your PR I get the following error:
In file included from /home/pixhawk/catkin_ws/src/avoidance/local_planner/src/nodes/local_planner.h:23:0,
                 from /home/pixhawk/catkin_ws/src/avoidance/local_planner/src/nodes/local_planner.cpp:1:
/home/pixhawk/catkin_ws/src/avoidance/local_planner/src/nodes/star_planner.h:52:50: fatal error: local_planner/LocalPlannerNodeConfig.h: No such file or directory
compilation terminated.
make[2]: *** [CMakeFiles/local_planner.dir/src/nodes/local_planner.cpp.o] Error 1
make[2]: *** Waiting for unfinished jobs....
In file included from /home/pixhawk/catkin_ws/src/avoidance/local_planner/src/nodes/star_planner.cpp:1:0:
/home/pixhawk/catkin_ws/src/avoidance/local_planner/src/nodes/star_planner.h:52:50: fatal error: local_planner/LocalPlannerNodeConfig.h: No such file or directory
compilation terminated.
make[2]: *** [CMakeFiles/local_planner.dir/src/nodes/star_planner.cpp.o] Error 1
In file included from /home/pixhawk/catkin_ws/src/avoidance/local_planner/src/nodes/local_planner.h:23:0,
                 from /home/pixhawk/catkin_ws/src/avoidance/local_planner/src/nodes/waypoint_generator.h:17,
                 from /home/pixhawk/catkin_ws/src/avoidance/local_planner/src/nodes/waypoint_generator.cpp:1:
/home/pixhawk/catkin_ws/src/avoidance/local_planner/src/nodes/star_planner.h:52:50: fatal error: local_planner/LocalPlannerNodeConfig.h: No such file or directory
compilation terminated.
make[2]: *** [CMakeFiles/local_planner.dir/src/nodes/waypoint_generator.cpp.o] Error 1
make[1]: *** [CMakeFiles/local_planner.dir/all] Error 2
make: *** [all] Error 2


api: Remove redundant API parameters

Description
This PR removes the redundant api parameters listed under listVirtualMachines API. The parameters are already defined in ListVMsCmdByAdmin class
(localcloud) 🐱 > list virtualmachines -h
listVirtualMachines: List the virtual machines owned by the account.
API Params               Type     Description
==========               ====     ===========
account                  string   list resources by account. Must be used w
                                  ith the domainId parameter.
...
hostid                   uuid     the host ID
hostid                   uuid     the host ID
...
podid                    uuid     the pod ID
podid                    uuid     the pod ID
...
storageid                uuid     the storage ID where vm's volumes belong
                                  to
storageid                uuid     the storage ID where vm's volumes belong
                                  to
...

Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[ ] Bug fix (non-breaking change which fixes an issue)
[ ] Enhancement (improves an existing feature and functionality)
[X] Cleanup (Code refactoring and cleanup, that may add test cases)

Feature/Enhancement Scale or Bug Severity
Screenshots (if appropriate):
How Has This Been Tested?

@blueorangutan package

@weizhouapache a Jenkins job has been kicked to build packages. It will be bundled with  KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

@blueorangutan package

Thanks for reviewing @GabrielBrascher , the following params: pod_id, storage_id, host_id, seem to be used only applicable only for root admins - https://github.com/apache/cloudstack/blob/main/server/src/main/java/com/cloud/api/query/QueryManagerImpl.java#L1004-L1011 , hence I took the following approach. It removes the redundant params and also ensures to behave the same way as before.

@Pearl1594 shouldn't a domain- or resource admin be allowed to list by host, pod, zone ?

Sorry @Pearl1594, I raised the question regarding  "Admins & Users".
However, my concerns are regarding what @DaanHoogland mentioned, Admins & Domain Admins.

It seems that only listing zones is allowed by domainAdmins - listing storage pools, hosts, clusters and pods, are restricted to root admins only. So, this change shouldn't effect any behavior.

@blueorangutan package

@Pearl1594 a Jenkins job has been kicked to build packages. It will be bundled with  KVM, XenServer and VMware SystemVM templates. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 2943

@blueorangutan test

@Pearl1594 a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Have tested different roles and as advised by @Pearl1594 the removed parameters only apply for ROOT admin


Cant connect to Firebase neither using FirebaseUI or Firebase Standard Auth methods

Welcome to FirebaseUI and thanks for submitting an issue!
Please take a look at open issues, as well as resolved issues, to see if your issue is either already being addressed, or has been solved by someone else.
If not, please feel free to fill in the following info so we can help faster!
Step 1: Are you in the right place?

For issues or feature requests related to the code in this repository file a GitHub issue.
For general technical questions, post a question on StackOverflow tagged appropriately.
For general Firebase discussion, use the firebase-talk google group
For help troubleshooting your application that does not fall under one of the above categories, reach out to the personalized Firebase support channel

Step 2: Describe your environment

Android device: Emulator - Nexus 5 API 28
Android OS version: 9
Google Play Services version: 49
Firebase/Play Services SDK version: 16.0.8
FirebaseUI version: 4.3.2

Step 3: Describe the problem:
I create a fisrt project in the console and tried to connect to my app using standard auth methods. Not only the last step of the app set-up did not finneshed because connection was never made and whem i invoque signInWithEmailAndPassword I always get the following error message: sign is falilure com.google.firebase.FirebaseNetworkException: A network error (such as timeout, interrupted
It's strange because i have made it in the past....I'm also having problems with ruby gems due to certificates, can this be a certificate issue or something?
I tried with another project, a course in Udacity for building an App Chat and I tried to use the Firebase UI, the result is the same, after entering the e-mail it takes a long time doing nothing and then in the log cat i see the following error:
2019-04-29 21:28:38.141 30303-30422/? E/PlayCommon: [1591] com.google.android.play.b.g.a(860): Failed to connect to server: java.net.UnknownHostException: Unable to resolve host "play.googleapis.com": No address associated with hostname
2019-04-29 21:28:58.157 29991-30054/? E/PlayCommon: [1553] com.google.android.play.b.g.a(860): Failed to connect to server: java.net.UnknownHostException: Unable to resolve host "play.googleapis.com":
and also this one :
2019-04-29 21:33:29.040 1202-1237/com.google.firebase.udacity.friendlychat E/FirebaseInstanceId: Token retrieval failed: AUTHENTICATION_FAILED
Steps to reproduce:

Observed Results:
Already explained above
Expected Results:
I was expecting to be able to coonect to Firebase and use the autentication services for my app
Relevant Code:
I don't think its a code issue, as mentioned above in either the projects the new app setups ends with sucess because connection is never established.

You have a lot of issues like this one:

Unable to resolve host "play.googleapis.com": No address associated with hostname

Have you tried this on either a real device or one of the emulators that has the Google Play Store on it?  Also what country are you in?  Sounds like your network is blocking google services.

@ricardolousada I am going to close this issue because it does not have anything to do with FirebaseUI.  I would suggest doing a few things:

Make sure you're using one of the emulator images with the Play store
Open the Play store and sign in, try to download an app
Make sure your emulator has a network connection and that you can load "google.com" in the browser

@samtstern  Thanks that was the issue :) I can run it on the real device, now i just need to discover how to get my emulator accessing the Internet
PS - From Portugal and running a MAC
Cheers.

@ricardolousada glad it was solved!


x/tools/cmd/getgo: installer does not work on alpine using sh

What version of Go are you using (go version)?
None yet, trying to install it!
What operating system and processor architecture are you using (go env)?
Linux amd64
What did you do?
$ docker pull alpine:latest
$ docker run -i -t alpine:latest /bin/sh
# apk update && apk add curl
# curl -LO https://get.golang.org/$(uname)/go_installer && chmod +x go_installer && ./go_installer && rm go_installer
Welcome to the Go installer!
Downloading Go version go1.8.3 to /root/.go
This may take a bit of time...
"" is not a supported shell

What did you expect to see?
Go installed (or at least "sh" is not a supported shell if bourne shells are required or something similar)
What did you see instead?
"" is not a supported shell

set -e SHELL=sh

Thanks! I didn't realize it was getting the name from $SHELL. Either way, sh does not appear to be supported sadly:

"/bin/sh" is not a supported shell

so the point of the installer is to mod the rc file for the shell so we
should probably add sh but also this is mainly geared towards people
setting up their dev env and i dont know how common sh will be
On Wed, Aug 23, 2017 at 3:03 PM, Sam Whited<EMAIL_ADDRESS>wrote:

Thanks! I didn't realize it was getting the name from $SHELL. Either way,
sh does not appear to be supported sadly:
"/bin/sh" is not a supported shell
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/golang/go/issues/21264#issuecomment-324432093, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ABYNbGg4VWdtqinvf86MgVisafDo-o9zks5sbHeUgaJpZM4OqT7s
.

--
Jessie Frazelle
4096R / D4C4 DD60 0D66 F65A 8EFC  511E 18F3 685C 0022 BFF3
pgp.mit.edu http://pgp.mit.edu/pks/lookup?op=get&search=0x18F3685C0022BFF3

I ran in that problem while creating a Docker with the latest version of Go.
Somehow, the SHELL variable was defined but the go_installer was not able to find it until I did:
export SHELL=/bin/bash

Then it worked as expected.

Closing - getgo is deprecated.  #60951


Bump devDependencies

https://github.com/webpack-contrib/coffee-loader/compare/v1.0.1...v2.0.0
https://github.com/webpack-contrib/less-loader/compare/v7.0.2...v7.2.0
https://github.com/vuejs/vue-loader/compare/v16.0.0-beta.8...v16.0.0

Can you update src/components/Vue.js as well? https://github.com/JeffreyWay/laravel-mix/blob/beebc037c07d298dcd64a9216b3a8396cff2f2a7/src/components/Vue.js#L59
Also I'd bump Vue Loader 16 to 16.1 instead of 16.0.


Quality of Help Patches

is sometimes not optimal. i'm missing comments to understand whats going on...

If you check the FieldGuide patches they should be much more nicely documented.  Would probably be nice to add some commentary to these ones too, but probably want happen anytime too soon :p
For concept of gradient specifically you can check the Gradient (SF2D.Operators) help patch,
or https://en.wikipedia.org/wiki/Gradient.

ok, thank you. i will have a look.
maybe add this reference to the patch. this is the kind of comment i was talking about ;)


Remove errant debug from auction EndBlocker

This PR's upgrade test failure is expected, see #292 for the same code with a successful test execution.


Add the AndroidX migration

Interesting build results @mattleibow  https://dev.azure.com/jamesmontemagno/Hanselman.Forms/_build/results?buildId=1381&view=logs&jobId=cfa20e98-6997-523c-4233-f0a7302c929f&j=275f1d19-1bd8-5591-b06b-07d489ea915a&t=fc1efd11-04e3-530f-bdaf-f23130eb71db
I think we need to upgrade the proguard file perhaps?

Interesting... I see the warning:
R8 : warning : The rule `-keep public class * extends androidx.versionedparcelable.VersionedParcelable {
    <init>();
  }` uses extends but actually matches implements.

That is weird, I don't think they changed the type from a class to an interface - and anyway, we are using jetifier to migrate the proguard. I'll have a look.
Both are interfaces in the NuGets:

https://www.fuget.org/packages/Xamarin.AndroidX.VersionedParcelable/1.0.0-preview02/lib/monoandroid90/Xamarin.AndroidX.VersionedParcelable.dll/AndroidX.VersionedParcelable/IVersionedParcelable
https://www.fuget.org/packages/Xamarin.Android.Support.VersionedParcelable/28.0.0/lib/monoandroid90/Xamarin.Android.Support.VersionedParcelable.dll/AndroidX.VersionedParcelable/IVersionedParcelable

The failure is a result of the jarsigner failing. Not sure what that is.


fix: remove scrimba link for inaccurate video

It has been decided to remove links to videos where the video is no longer accurate.

[x] I have read freeCodeCamp's contribution guidelines.
[x] My pull request has a descriptive title (not a vague title like Update index.md)
[x] My pull request targets the master branch of freeCodeCamp.
[x] All the files I changed are in the same world language, for example: only English changes, or only Chinese changes, etc.

Closes https://github.com/freeCodeCamp/freeCodeCamp/issues/37760

Thank you @moT01 for your contribution to the page! 👍
We're happy to accept these changes, and look forward to future contributions. 🎉
I will perform a search on the forum to find all such videos and I will reach out to the forum mods in case they have seen others.


Add additional language bindings

spark-connect-rs
spark-connect-go
spark-connect-csharp

#233 closes out the Rust bindings


Fix for HCLS blueprint.

Submission Checklist
Please take the following actions before submitting this pull request.

Fork your PR branch from the Toolkit "develop" branch (not main)
Test all changes with pre-commit in a local branch #
Confirm that "make tests" passes all tests
Add or modify unit tests to cover code changes
Ensure that unit test coverage remains above 80%
Update all applicable documentation
Follow Cloud HPC Toolkit Contribution guidelines #

Looks good, reassign to me when you are done with testing.

We need to verify this solution, but since this allows for the blueprint to be created we can move forward with this part of the fix.


Upgrade fluent-bit

Overview / Motivation
We met fluent-bit bugs as documented in:
https://github.com/fluent/fluent-bit/issues/798
The Task
Need to upgrade fluent-bit to version>1.1.1
Implementation Notes
TODO: Add links to relevant resources, specs, related issues, etc...
Contribution Guidelines
Important: Issue assignment to developers will be by the order of their application and proficiency level according to the tasks complexity. We will not assign tasks to developers who have'nt introduced themselves on our Gitter dev channel

Introduce yourself on go-spacemesh dev chat channel - ask our team any question you may have about this task
Fork branch develop to your own repo and work in your repo
You must document all methods, enums and types with godoc comments
You must write go unit tests for all types and methods when submitting a component, and integration tests if you submit a feature
When ready for code review, submit a PR from your repo back to branch develop
Attach relevant issue to PR

Upgraded to 1.2.0


⚠ Bofrost.de has degraded performance

In 76b8022, Bofrost.de (https://www.bofrost.de) experienced degraded performance:

HTTP code: 200
Response time: 1350 ms

Resolved: Bofrost.de performance has improved in b758b25.


If starts are equal, then sort by ends

If starts are equal, then should display first to end, first

Done


Time to make PICO_NO_FPGA_CHECK the default?

When exploring the resource usage of a program, I was surprised to find running_on_fpga() appearing as an actual function rather than being eliminated at build time, and traced that to the default being:
// PICO_CONFIG: PICO_NO_FPGA_CHECK, Remove the FPGA platform check for small code size reduction, type=bool, default=0, advanced=true, group=pico_runtime #ifndef PICO_NO_FPGA_CHECK #define PICO_NO_FPGA_CHECK 0 #endif
in pico/platform.h
Surely at this stage of the development with millions of developers out there working with real devices and only a handful of in-house developers maybe still using FPGA once in a blue moon, the time has come to at least flip the default to '1'.
I appreciate it's only 48 bytes, but I think the justification is more about this unexpected code turning up in people's binaries and wasting time while they track down what it's doing there.
Ideally the whole FPGA support would be expunged from the public code base as it's just a source of confusion/timewasting and no practical value to nearly all the users, but if it is still seen as useful for in-house use at least the compromise of turning it off by default would be an improvement.

seems reasonable

it is now the default


hosting policy reporter UI from a sub path

Hi,
Is there any option to host the policy reporter UI from a sub path?
Regards,
Shilpa

hey, thank you for your request.
Do you mean something like "https://domain.com/policy-reporter-ui" ?

@fjogeleit: yes

This feature already exists. It's in the UI Subchart
https://github.com/kyverno/policy-reporter/blob/main/charts/policy-reporter/charts/ui/values.yaml#L75-L89
So you can configure it in your policy-reporter values.yaml under the ui configuration.
ui:
  ingress:
    enabled: false
    ...

I somehow missed it :/ Thank you 👍

Configuring ingress is not enough. I tried this out by configuring an ingress resource manually and it did not work.
Does the underlying UI application support being hosted on a sub-path?
Could you please support this?

Configuring ingress is not enough. I tried this out by configuring an ingress resource manually and it did not work.
Does the underlying UI application support being hosted on a sub-path?
Could you please support this?

I will try to create an example today

@fjogeleit: nginx. ingress-nginx to be specific: https://github.com/kubernetes/ingress-nginx

I tried it by myself and I'm sorry but it's not that easy as it should. Because VueJS need the subPath at build time, so it is static defined in the docker image and I did not find a solution to configure it at runtime.
I will try to find a solution but it can take a few days.

@fjogeleit: Thank you for the update

@shilpa-0 I found a solution for this problem and created a new Policy Report UI version. I will publish a new helm release soon. If you want to try it out before you can use a similar configuration like this:
I
ui:
  image:
    tag: 0.13.2

  enabled: true

  plugins:
    kyverno: true

  ingress:
    enabled: true
    annotations:
      nginx.ingress.kubernetes.io/rewrite-target: /$1
    hosts:
      - host: domain.com
        paths:
        - "/policy-reporter/(.*)"

Important - the UI will be available under http://domain.com/policy-reporter/ - the last / is required.

The subPath support is released with 1.8.7 of the Helm Chart


Wrong keyboard layout

The app uses a default (EN) keyboard layout, which makes it for me not really usable :(
Didn't see any app which forces it's own keyboard layout other than what you've setup in Windows.

The desktop shell for this is very simple, all it did was to send raw key events. For version two I'm using the official desktop shell so it should adapt to different keyboard layout once that's out.


Module not receiving shared data on IOS

https://user-images.githubusercontent.com/44324439/122989451-44695c00-d3bc-11eb-88fd-6b4765919f9a.mov
Checkout the above video

@caiosba could you please help me about it?

working right now because in my application i used to schemas that was the problem


a button to email the registrar requesting Student SL Course participation

did: Created a new button for Import Course Participant and made a modal for it where the participant can see options to upload and submit their approved Excel file from the registrar. When submitted the data from the Excel will be extracted and saved into the database.
test: We know that it works because we checked the database and we found out that it saved the data from the Excel files we submitted, and the modal was successfully displayed as the new button, import Course Participant, was clicked.

 Request student participation log from registrar #646


Add an 'about versions' option in the versions dropdown

Contributions

[X] I have read the contribution docs, and understand what's expected of me.

What page(s) or areas on docs.getdbt.com are affected?
Suggesting to add an 'about core version' section to the existing docs site in the versioning dropdown.
dbt docs:
What changes are you suggesting?
Suggesting to add an 'about core version' section and link to the versioning dropdown. Similar to github's example:
github:

Additional information
No response

closing this as this isn't something we can support right now


BL-309 changed API_TOKEN inside the env sample file

Description
The notion documentation, shows a different field for the okta api token than the one that is currently in place. This might get a bit confusing for some developers, so I simply replaced API_TOKEN from the .env sample file and also the usage of it in oktaClient file inside the lib folder with OKTA_API_TOKEN. The register route still works perfectly fine.
Fixes # (issue)
Loom Video
Type of change

[x] Bug fix (non-breaking change which fixes an issue)

Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] I have removed unnecessary comments/console logs from my code
[x] I have made corresponding changes to the documentation if necessary (optional)
[x] My changes generate no new warnings
[x] I have checked my code and corrected any misspellings
[x] No duplicate code left within changed files
[x] Size of pull request kept to a minimum
[x] Pull request description clearly describes changes made & motivations for said changes

Great catch, I think this will definitely help people coming on to this project!


"X minute read" instead of "X minutes read"

minor grammar error
fixed here

@camhashemi I think you used the wrong link here by accident?
Probably wanted https://github.com/avianto/hugo-kiera/pull/42

Haha yes, thank you @bearbob

Hi @camhashemi, I don't believe this repo is actively maintained. I've submitted my fork https://github.com/funkydan2/hugo-kiera to the Hugo Theme repository and it is actively maintained (and your fix has already been made there).


io500: update for SC'20 changes

remove the io-500-dev (bash script) checkout from prepare.sh
remove running io500-scr from io500.sh
remove parts of io500.sh that are no longer used
update README-sc20.txt to remove references to bash version
update .gitignore to skip temporary files

Signed-off-by: Andreas Dilger<EMAIL_ADDRESS>

I approve


[Automated] Format markdown

Produced via:
prettier --write --prose-wrap=always $(find -name '*.md' | grep -v vendor | grep -v .github | grep -v docs/cmd/)

Justification, Sync the new releasability workflow -mattmoor
/cc we don't use Prow
/assign we don't use Prow

Codecov Report

Merging #197 (849abeb) into master (4dd8e8c) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #197   +/-   ##
=======================================
  Coverage   79.97%   79.97%
=======================================
  Files          20       20
  Lines         734      734
=======================================
  Hits          587      587
  Misses        134      134
  Partials       13       13

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4dd8e8c...849abeb. Read the comment docs.


Fix scala version typo

Current coverage is 85.01%

Merging #127 into master will not affect coverage as of 9854fea

@@            master    #127   diff @@
======================================
  Files           10      10
  Stmts          407     407
  Branches       125     125
  Methods          0       0
======================================
  Hit            346     346
  Partial          0       0
  Missed          61      61

Review entire Coverage Diff as of 9854fea

Powered by Codecov. Updated on successful CI builds.

Thanks!


[7.0.1] Please ignore. This is for testing

Forked from #431

Cherry-pick was attempted, but failed to push. Please check if the branch, cp431-7.0.1, already exists
cc: @bazelbuild/triage


Worker recycled when connecting

Hello,
I just ran a docker instance of webssh.
But when I try to connect to my host, the authentication is successfull but the worker is beign recylced instantly.
Any idea ?

web_1  | [I 190419 14:12:40 web:2246] 200 GET / (<IP_ADDRESS>) 2.64ms
web_1  | [I 190419 14:12:41 web:2246] 304 GET /static/css/bootstrap.min.css (<IP_ADDRESS>) 5.19ms
web_1  | [I 190419 14:12:41 web:2246] 304 GET /static/css/xterm.min.css (<IP_ADDRESS>) 9.19ms
web_1  | [I 190419 14:12:41 web:2246] 304 GET /static/css/fullscreen.min.css (<IP_ADDRESS>) 11.34ms
web_1  | [I 190419 14:12:41 web:2246] 304 GET /static/js/jquery.min.js (<IP_ADDRESS>) 12.82ms
web_1  | [I 190419 14:12:41 web:2246] 304 GET /static/js/popper.min.js (<IP_ADDRESS>) 14.09ms
web_1  | [I 190419 14:12:41 web:2246] 304 GET /static/js/xterm.min.js (<IP_ADDRESS>) 0.72ms
web_1  | [I 190419 14:12:41 web:2246] 304 GET /static/js/main.js (<IP_ADDRESS>) 0.95ms
web_1  | [I 190419 14:12:41 web:2246] 304 GET /static/js/bootstrap.min.js (<IP_ADDRESS>) 2.53ms
web_1  | [I 190419 14:12:41 web:2246] 304 GET /static/js/fullscreen.min.js (<IP_ADDRESS>) 1.88ms
web_1  | [I 190419 14:12:45 handler:313] Connecting to my.host:22
web_1  | [I 190419 14:12:45 transport:1746] Connected (version 2.0, client OpenSSH_7.4p1)
web_1  | [I 190419 14:12:45 transport:1746] Authentication (password) successful!
web_1  | [I 190419 14:12:45 web:2246] 200 POST / (<IP_ADDRESS>) 180.05ms
web_1  | [W 190419 14:12:48 worker:16] Recycling worker<PHONE_NUMBER>21160
web_1  | [I 190419 14:12:48 worker:99] Closing worker<PHONE_NUMBER>21160 with reason: worker recycled
web_1  | [I 190419 14:12:48 worker:106] Connection to my.host:22 lost

Hi TomEscolano,
Normally the log looks like this,

You see there is a GET request issued immediately after the POST request.
Do you use a browser?
If you do, check if there is any error message in your browser console.

Hi,
Yes, I use a browser (Latest version of Firefox).
I just checked my console and there is an error in Jquery.min.js

I can't get my hands on this error...

Hi,
Can you tell me the whole url by which you access to the webssh page?

I access the webssh page via the following URL:

http://<IP_ADDRESS>:8888/#port=22&host=localhost

I've added a little JS script to the page to prefill the inputs of the form with URL given parameters

Yes, the syntax error was caused by your URL.
main.js currently can't handle this kind of url format.

Hi TomEscolano,
Maybe you can pass values in this way:

http://<IP_ADDRESS>:8888/?port=22&host=localhost

Fixed https://github.com/huashengdun/webssh/commit/d69d8cfa7a4d15fb081aede9e2b3e49a21fb8435

Hi TomEscolano,
I have updated main.js, now it supports passing arguments by url like:
http://localhost:8888/#hostname=xx&username=yy
http://localhost:8888/?hostname=xx&username=yy


[UWP] XamlBuilder TryGetResourceFromResourceDictionaries isn't checking HasKey

XamlBuilder::TryGetResourceFromResourceDictionaries does a straight lookup on the resource key instead of checking HasKey first.

Fix here https://github.com/Microsoft/AdaptiveCards/pull/1251