NTR: effector-mediated supression of host host salicylic acid-mediated signal transduction pathway

NTR: effector-mediated suppression of host salicylic acid-mediated host innate immune signalling.
A process mediated by a molecule secreted by a symbiont that results in the suppression of host salicylic acid-mediated host innate immune signalling.
descendant of
GO:0052003 suppression by symbiont of defense-related host salicylic acid-mediated signal transduction pathway
and
GO:0140404 | effector-mediated modulation of host innate immune response by symbiont
I suspect this will always be "effector-mediatedf' so we might be able to make GO:0052003 more specific

PMID:30651637
and
PMID: 25438793
Kumar, D. Salicylic acid signaling in disease resistance. Plant Sci. 228, 127–134 (2014).

Note that these  symbiont terms have parentage to the equivalent  host terms

Can I removed one instance of 'host'?
effector-mediated suppression of host salicylic acid-mediated ~host~ innate immune signalling. ?
(same in definition)

+[Term]
+id: GO:0140502
+name: effector-mediated suppression of host salicylic acid-mediated innate immune signalling
+namespace: biological_process
+def: "A process mediated by a molecule secreted by a symbiont that results in the suppression of host salicylic acid-mediated innate immune signalling." [PMID:25438793, PMID:30651637]
+is_a: GO:0052003 ! suppression by symbiont of defense-related host salicylic acid-mediated signal transduction pathway
+is_a: GO:0140404 ! effector-mediated modulation of host innate immune response by symbiont
+property_value: term_tracker_item https://github.com/geneontology/go-ontology/issues/19848 xsd:anyURI
+created_by: pg
+creation_date: 2020-08-11T06:16:36Z


🍒 Cherry pick PR #9224 to staging 🍒

🍒 Cherry pick https://github.com/Expensify/App/pull/9224 to staging 🍒

🚀 Cherry-picked to staging by @OSBotify in version: 1.1.69-2 🚀

platform
result

🤖 android 🤖
success ✅

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
success ✅

🕸 web 🕸
success ✅

@Expensify/applauseleads please QA this PR and check it off on the deploy checklist if it passes.


[ISSUE #2007]Fastjson has a serious security problem in 1.2.62,which will cause RCE

Fastjson has a serious security problem in 1.2.62,which will cause RCE
Fix https://github.com/apache/rocketmq/issues/2007
What is the purpose of the change
Fastjson has a serious security problem in 1.2.62,which will cause RCE
Brief changelog
Fastjson has a serious security problem in 1.2.62,which will cause RCE
Verifying this change
Fastjson has a serious security problem in 1.2.62,which will cause RCE

Coverage decreased (-0.06%) to 50.897% when pulling a60d93890351df5f4e82c748e38ef200f55c644b on wcc526:patch-2 into 7f105361022f3a0de8c1d6feda04d5eba3dba6bb on apache:develop.

Codecov Report

Merging #2008 into develop will not change coverage.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             develop    #2008   +/-   ##
==========================================
  Coverage      45.15%   45.15%
  Complexity      4202     4202
==========================================
  Files            545      545
  Lines          35732    35732
  Branches        4744     4744
==========================================
  Hits           16135    16135
  Misses         17554    17554
  Partials        2043     2043

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7f10536...a60d938. Read the comment docs.


Test suite deletes all your forms

The current test suite deletes all your forms in your account.
Double-check everything runs on mock servers.

Confirmed.
Instead of deleting test form here is deleting of all forms of the selected workspace.

PR https://github.com/Typeform/typeform-python-sdk/pull/31


Group MessageReceived notifications

To reduce the noise of the notifications

Hi @mattwr18, so this is what I thought of to simplify the grouping.
For each notification class (e.g. MessageReceived), we could add a group_key method:
class MessageReceived < Noticed::Base
  def group_key
    "message-received-#{request.id}
  end
end

For notifications that shouldn’t be grouped, you can simply define the group_key in a way that ensures that every notification has a unique key. For example, there will be exactly one OnboardingCompleted notification per contributor:
class OnboardingCompleted < Noticed::Base
  def group_key
    "onboarding-completed-#{contributor.id}
  end
end

In the controller, you can then simply group notifications like this:
groups = user.notifications.newest_first.group_by(&:group_key)

In order to format message nicely, we could define a class method on each notification class…
class MessageReceived < Noticed::Base
  def self.group_message(notifications:)
    t('.message',
      request: notifications.first.request.title,
      contributor_one: notifications.first.contributor.name,
      contributor_two: notifications.second&.contributor.name
      count: notifications.size,
    )
  end
end

… and use it like this:
class NotificationGroup
  def message
    notifications.first.class.message(notifications)
  end
end

Given translations as follows, I think we would be able to generate messages in a way that isn’t too complex and that works in a generic way, i.e. would work out of the box for new notificatoin types as well.
message_received:
  one: '%{contributor_one} has replied to request “%{request}”'
  two: '%{contributor_one} and %{contributor_two} have replied to request “%{request}”'
  other: '%{contributor_one} and %{count} others have replied to request ”%{request}”'

Hey @tillprochaska thanks for writing down what you were thinking of. I have given your approach a go and have some thoughts.

I really like the idea of adding a group_key to the individual ActivityNotification types' classes. This has indeed simplified the logic.

As far as adding a NotificationGroup, I got it working that way, but realized that it could be simplified by removing it and just calling a helper method directly from the controller to the  individual ActivityNotification types' classes. This meant that I did not need to access current_user from the helper methods as the notifications where already scoped when I passed them into the group_message method.

Regarding the benefit of the NotificationGroup in being able to add helper methods, I don't see that as necessary since we already have the  individual ActivityNotification types' classes.

As far as formatting messages, I had not added the :two key and customized message, but another benefit of your idea is that we have access to the second contributor name. I have now added this new message and test cases.

Overrall, I am quite happy with your help! Please have a look and let me know what you think
See ef54d83b106995911aa1ccefbf0d21f15b654cbc and f8bc359c


⚠ Quirk Club Argentina (API endpoint) has degraded performance

In ef89902, Quirk Club Argentina (API endpoint) (https://us-central1-quirkclub-dev.cloudfunctions.net/api/check/api) experienced degraded performance:

HTTP code: 200
Response time: 8210 ms

Resolved: Quirk Club Argentina (API endpoint) performance has improved in e2b409b.


Question about barcode length in mock2 and mock6

Hello,
Thanks for explanations in #76.
one more question about mock 2 and 6.
The barcode indicated in mock 2 and 6 are respectively of length 12 and 6, but in their mock-index-reads.fastq, index are respectively of length 13 and 7.
exemple of mock2:
barcode in sample_metadata.tsv is : ATCTGCCTGGAA
If I search perfect match in the index fastq file I foun:

     23 AATCTGCCTGGAA
 243167 ATCTGCCTGGAAA
    446 ATCTGCCTGGAAC
     17 ATCTGCCTGGAAG
      1 ATCTGCCTGGAAN
    681 ATCTGCCTGGAAT
     62 TATCTGCCTGGAA

Is the correct barcode ATCTGCCTGGAAA (with a A at the end) ?
What is your advice?
Same problem with mock6

      ACCTGT          ACCTCG          ACCGCA
    951 AACCTGT	    195 AACCTCG	     58 AACCGCA
   2212 ACCTGTA	 210433 ACCTCGA	   1245 ACCGCAA
 277218 ACCTGTC	  36791 ACCTCGC	   5589 ACCGCAC
   4911 ACCTGTG	   1878 ACCTCGG	 312775 ACCGCAG
   1399 ACCTGTT	   5707 ACCTCGT	   2041 ACCGCAT
     24 CACCTGT	     16 CACCTCG	      1 GACCGCA
      1 GACCTGT	     10 GACCTCG	     90 TACCGCA
     46 TACCTGT	      1 NACCTCG
                   1092 TACCTCG

Many thanks for these datasets!

@MathieuCharles thanks for finding this issue! I have not noticed this previously as, evidently, it does not impact the ability of qiime to demultiplex these data.
I am still trying to figure out why the barcode files are 1 nt longer than the sample-metadata (all data are provided by contributors so may take time to track down) but for now it seems like a reasonable assumption that the most common match (which in most cases appears to be more than 100-fold more common than other matches) is the correct one.


Resolve test failures from fugue=0.8.0

It looks like the API of FugueSQLWorkflow has changed such that we no longer pass through an execution engine at creation; this PR changes things accordingly to unblock CI.

Codecov Report

Merging #990 (fa8115d) into main (472eff0) will increase coverage by 2.06%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##             main     #990      +/-   ##
==========================================
+ Coverage   75.24%   77.31%   +2.06%
==========================================
  Files          75       75
  Lines        4218     4218
  Branches      766      766
==========================================
+ Hits         3174     3261      +87
+ Misses        878      784      -94
- Partials      166      173       +7

Impacted Files
Coverage Δ

dask_sql/integrations/fugue.py
85.71% <0.00%> (-14.29%)
:arrow_down:

dask_sql/physical/rex/core/literal.py
58.09% <0.00%> (-2.86%)
:arrow_down:

dask_sql/physical/rel/logical/window.py
95.37% <0.00%> (-1.74%)
:arrow_down:

dask_sql/_version.py
32.76% <0.00%> (-1.13%)
:arrow_down:

dask_sql/input_utils/hive.py
100.00% <0.00%> (+81.74%)
:arrow_up:

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

We should be good leaving the min version as is, since IIUC this style of using FugueSQLWorkflow was also supported for fugue 0.7.0.
That being said, I'm okay with bumping to the most recent patch release of fugue 0.7 (0.7.3) to see if that resolves the occasional failures we see on macOS.

We should be good leaving the min version as is, since IIUC this style of using FugueSQLWorkflow was also supported for fugue 0.7.0.
That being said, I'm okay with bumping to the most recent patch release of fugue 0.7 (0.7.3) to see if that resolves the occasional failures we see on macOS.

Yeah let's try 0.7.3 to see if that reduces the occasional failures on the 3.8 tests on Mac and sometimes windows


How can i update title of barview?

Xcode 10.1 XLPagerTabStrip
I have 4 tab
tab1 . tab2.  tab3. tab4
case1.
if current index is tab1
  if let pagerTabStrip = self.parent as? ButtonBarPagerTabStripViewController {

       pagerTabStrip.buttonBarView.reloadData()

}

this code is work perfectly
case2.
if current index is tab3  but i want to update title of tab1
 if let pagerTabStrip = self.parent as? ButtonBarPagerTabStripViewController {

       pagerTabStrip.buttonBarView.reloadData()

}

this code didn't work .
how can i update bar title from  another tab

I have same issue i need to use search that return different results and i need to update the pages title like:
Items(5) ---- Stuff(2) ---- Elec(10)
while items, stuff, elec are my pages
thanks.

Have you tried using reloadPagerTabStripView()?
It will ask you for the new view controllers and tabinfo again then you can move to desired view controller if needed.
Example app shows how to use it.

    open override func reloadPagerTabStripView() {
        super.reloadPagerTabStripView()
        guard isViewLoaded else { return }
        buttonBarView.reloadData()
        cachedCellWidths = calculateWidths()
        buttonBarView.moveTo(index: currentIndex, animated: false, swipeDirection: .none, pagerScroll: .yes)
    }


use domainnet dataset

Hi ,thanks for your excellent work.
Have you ever try to work on the domainNet dataset ? SInce I can't get satisfied result by changing the dataset only.

Hi ,thanks for your excellent work. Have you ever try to work on the domainNet dataset ? SInce I can't get satisfied result by changing the dataset only.

Hi, maybe you need to change the learning rate and adjust the weights of different loss objectives by yourself since DomainNet owns an extremely imbalanced label distribution.
Best

Hi, thanks for your response. But I still want to know whether the kmeans is still work in domainnet. (From my experiment  result, I found it's not work well ) Since the number of classes is 345, the variable of k in kmeans has better to be a smaller one, like 8. Is it necessary to change another method to optimize the pseudo lable during the training process? Do you have any suggestions? Thank you very much！
Best

Hi, thanks for your response. But I still want to know whether the kmeans is still work in domainnet. (From my experiment result, I found it's not work well ) Since the number of classes is 345, the variable of k in kmeans has better to be a smaller one, like 8. Is it necessary to change another method to optimize the pseudo lable during the training process? Do you have any suggestions? Thank you very much！ Best

You can try the updated code for DomainNet again.


Unable to obtain the name of audio inputs

AudioIn service is not present, which allows one to obtain the names of the RCA audio inputs.

It would be good see this added.
(I have quite good support for Line-In in soco-cli, but it would be nice to be able to nominate Line-In sources by name.)


Upgrade version of ansible

As of this point, the included version of ansible is 2.10.5.  There are newer 3.x and 4.x packaged versions available to get 2.11+.  There are also updates available for other dependencies as well.  Merging #14 might kill two birds with one stone here.

Merged #14. New image should be incoming!


Autocomplete after truncate not implemented

Autocomplete after truncate not implemented. DBeaver 6.3.3. Postgresql.

Truncate bug fixed.
Please create separate ticket for another completion bug.

Verified (truncate)


encryption_key_name not working as expected

Dear all
I am using this module to maintain postgres instances in gcloud with enusiasm. I already created instances without encryption (or with default encryption). Now I have to create an instance with a customer managed key. I have the following configuration in my main.tf

module "postgres" {
  source             = "GoogleCloudPlatform/sql-db/google//modules/postgresql"
  version            = "3.2.0"
  name               = "${var.env}-${var.db_name}-${random_string.rng.result}"
  database_version   = var.db_version

  project_id         = var.project_id
  region             = var.db_region
  zone               = var.db_zone
  tier               = var.db_tier
  encryption_key_name = "projects/${var.project_id}/locations/${var.kms_location}/keyRings/${var.kms_keyring}/cryptoKeys/${var.env}-manual-storage"

  maintenance_window_day = 7
  maintenance_window_hour = 7
  maintenance_window_update_track = "stable"

  user_name          = var.db_user_name
  user_password      = random_password.password.result

  additional_users   = [
    {
      name     = "task"
      password = random_password.password.result
      host     = "localhost"
      instance = "task"
      project = var.project_id
    },
  ]

  additional_databases = [
    {
      name = "task"
      charset = "UTF8"
      collation = "en_US.UTF8"
      instance = "task"
      project = var.project_id
    },
  ]

  backup_configuration = {
    enabled = true
    start_time = "00:00"
  }

  ip_configuration = {
    ipv4_enabled = true
    // this is ugly as ..., private network should be enabled instead
    private_network = null
    require_ssl = true
    authorized_networks = var.db_authorized_networks
  }
}

With terraform plan everything looks fine, but when I apply the configuration I receive the following error after approx. 10minutes.
Error: Error, failed to create instance dev-tf-rppuy: googleapi: Error 409: The instance or operation is not in an appropriate state to handle the request., invalidState

  on .terraform/modules/postgres/terraform-google-sql-db-3.2.0/modules/postgresql/main.tf line 26, in resource "google_sql_database_instance" "default":
  26: resource "google_sql_database_instance" "default" {

Is it a bug or do I have a mistake in my configuration?

Since the plan is succeeding, could you file a provider issue and include the debug log? It seems there's something wrong with the sequencing.

Thanks for your quick answer.
I will open an issue in the google provider then.
But anyways, here is the debug log:
debug.log


Hi team, request help for accessing proxyee.

In my mind, there are two VPS A and B in same VPC, then I will add a top route rule for this VPC <IP_ADDRESS>/0 -> B. This means all the traffic from VPS A will be lead to B. And I will start a proxyee service in VPS B. Also, I will config iptables on VPS B by command below:
sudo iptables -t nat -A PREROUTING -s <IP_ADDRESS>/24 -p tcp --dport 443 -j REDIRECT --to-port 80
sudo iptables -t nat -A PREROUTING -s <IP_ADDRESS>/24 -p tcp --dport 80 -j REDIRECT --to-port 80

Then all the traffic from VPS A will go through netty proxyee. I have already installed the certificate on VPS A.
I hope to use this way to hide proxy to client.
I tried two ways by sending request from VPS A.
First:
curl -x proxyeeIp:port https://www.google.com. In this way, everything works well, with -v option, I can see the certificate is using correctly. But it needs me explicitly config proxy.
Second:
curl  https://www.google.com. In this way, this traffic will be lead to proxyee based on route table and iptables configuraiton, but I will got error like below:
11:16:26.614 [nioEventLoopGroup-4-1] INFO proxyee.handler.HttpProxyServerHandler -- channelRead: /bad-request
11:16:26.615 [nioEventLoopGroup-4-1] INFO proxyee.util.ProtoUtil -- uri: /bad-request
DefaultFullHttpRequest(decodeResult: failure(java.lang.IllegalArgumentException: invalid version format: HÍÞŸ,Þ¨ÞÉÊÅÃÄKXGAÅ {EQGSSÌ�~<GÞ[2¸Ü[#¢ÕU|>À,À0Ì©Ì¨ÌªÀ+À/À$À(KÀ#À'GÀ), version: HTTP/1.0, content: UnpooledByteBufAllocator$InstrumentedUnpooledUnsafeHeapByteBuf(ridx: 0, widx: 0, cap: 0))

Sometimes the error message is netty exception about invalid version format.
I tried to debug and I found the invalid message comes from io.netty.handler.codec.http.HttpObjectDecoder.splitInitialLine(ByteBuf asciiBuffer). I check this method's responsibility by debugging the First way. This method will format bytes to string which will contains uri, http method and etc.
I don't understand why this error happens on Second way. If it's related to SSL certificate, the first way shouldn't success.
Could someone help? Thanks a lot!

I know what you mean, but unfortunately proxyee not support transparent mode currently, It only follow standard HTTP proxy.

Thanks, if I want to add code to support transparent mode? Shall I get some suggestions of how to do?

Transparent mode has no handshake step, so I think the packet should be entry here directly, you can add a transparent flag on HttpProxyServerConfig, if it set true then skip handshake.
Looking forward to the results of your test, and can contribute to the project if it works!

Thanks a lot! I suddenly found an error in my description.  I'm sure I need use VPC route and iptables PREROUTING to redirect traffic to proxyee. Next, I do need forward request to 3rd parties' proxy which is in public net. In this way, is .proxyConfig(proxyConfig) what I need?

Yes, that's right.


Components in new Version based on Tailwind CSS ?

Hi Team,
Here https://github.com/swiss/styleguide/issues/661 was already mentioned that new version will be based on Tailwind CSS and published on storybook. My question: Will be components Web Components or something other?
I'd like to know because We're updating whole project to newest Angular 12.
Thanks for Answer

@msio If you use Angular anyway, maybe https://oblique.bit.admin.ch/ is something for you?

@hupf  great stuff. thanks

So far I know, the new version will be CSS & HTML only. The goal is to let everyone use their preferred JS framework.
As @hupf said, if you're already working with Angular, Oblique may be what you need. Though it's not yet clear how and when, the new guidelines will be integrated to Oblique once available.


Reorganize state machine module

Currently, mod state_machine is a single large file that's difficult to navigate.
Organize the state machine code into separate files and subdirs.  Anything that has multiple (sub)modules goes into its own subdir, but anything that just has a single mod gets a file in its parent's module dir.

Codecov Report

Merging #27 (4b84ea0) into main (e87f997) will decrease coverage by 0.44%.
Report is 1 commits behind head on main.
The diff coverage is n/a.

:exclamation: Current head 4b84ea0 differs from pull request most recent head 6b4cec6. Consider uploading reports for the commit 6b4cec6 to get more accurate results

@@            Coverage Diff             @@
##             main      #27      +/-   ##
==========================================
- Coverage   78.75%   78.31%   -0.44%
==========================================
  Files          12       12
  Lines        1365     1365
==========================================
- Hits         1075     1069       -6
- Misses        290      296       +6

Files
Coverage Δ

src/state_machine/mod.rs
73.23% <ø> (ø)

... and 2 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

Didn't start from current main, so was unable to merge without an ugly rebase.  Do it over from the correct starting point.


Unhelpful exceptions from tf.truncated_normal with dtype=tf.int32

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): NO
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linux Ubuntu 14.04 LTS
TensorFlow installed from (source or binary): pip install tensorflow
TensorFlow version (use command below): ('v1.3.0-rc2-20-g0787eee', '1.3.0')
Python version: Python 2.7.6
Bazel version (if compiling from source): N/A
CUDA/cuDNN version: N/A (CPU)
GPU model and memory: N/A
Exact command to reproduce:

python -c "import tensorflow as tf ; tf.truncated_normal([1], dtype=tf.int32)"
Describe the problem
When attempting to initialize a tf.Variable of type tf.int32 using tf.truncated_normal(), invocation with simple args raise a TypeError, but the error message is ambiguous and unhelpful for debugging:
python -c "import tensorflow as tf ; tf.truncated_normal([1], dtype=tf.int32)"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/ops/random_ops.py", line 168, in truncated_normal
    mean_tensor = ops.convert_to_tensor(mean, dtype=dtype, name="mean")
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/framework/ops.py", line 611, in convert_to_tensor
    as_ref=False)
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/framework/ops.py", line 676, in internal_convert_to_tensor
    ret = conversion_func(value, dtype=dtype, name=name, as_ref=as_ref)
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/framework/constant_op.py", line 121, in _constant_tensor_conversion_function
    return constant(v, dtype=dtype, name=name)
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/framework/constant_op.py", line 102, in constant
    tensor_util.make_tensor_proto(value, dtype=dtype, shape=shape, verify_shape=verify_shape))
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/framework/tensor_util.py", line 376, in make_tensor_proto
    _AssertCompatible(values, dtype)
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/framework/tensor_util.py", line 302, in _AssertCompatible
    (dtype.name, repr(mismatch), type(mismatch).__name__))
TypeError: Expected int32, got 0.0 of type 'float' instead.

Providing more arguments to tf.truncated_normal correctly indicates that tf.int32 isn't a supported type:
python -c "import tensorflow as tf ; tf.truncated_normal([1], mean=0, stddev=1, dtype=tf.int32)"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/ops/random_ops.py", line 172, in truncated_normal
    shape_tensor, dtype, seed=seed1, seed2=seed2)
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/ops/gen_random_ops.py", line 316, in _truncated_normal
    seed=seed, seed2=seed2, name=name)
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/framework/op_def_library.py", line 700, in apply_op
    attr_value.type = _MakeType(value, attr_def)
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/framework/op_def_library.py", line 179, in _MakeType
    _SatisfiesTypeConstraint(i, attr_def, param_name=attr_def.name)
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/framework/op_def_library.py", line 60, in _SatisfiesTypeConstraint
    ", ".join(dtypes.as_dtype(x).name for x in allowed_list)))
TypeError: Value passed to parameter 'dtype' has DataType int32 not in list of allowed values: float16, float32, float64

Contrasting this with usage of complex64, which provides the correct error message even with simple args:
python -c "import tensorflow as tf ; tf.truncated_normal([1], dtype=tf.complex64)"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/ops/random_ops.py", line 172, in truncated_normal
    shape_tensor, dtype, seed=seed1, seed2=seed2)
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/ops/gen_random_ops.py", line 316, in _truncated_normal
    seed=seed, seed2=seed2, name=name)
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/framework/op_def_library.py", line 700, in apply_op
    attr_value.type = _MakeType(value, attr_def)
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/framework/op_def_library.py", line 179, in _MakeType
    _SatisfiesTypeConstraint(i, attr_def, param_name=attr_def.name)
  File "/usr/slacy/src/tf_clean/env/local/lib/python2.7/site-packages/tensorflow/python/framework/op_def_library.py", line 60, in _SatisfiesTypeConstraint
    ", ".join(dtypes.as_dtype(x).name for x in allowed_list)))
TypeError: Value passed to parameter 'dtype' has DataType complex64 not in list of allowed values: float16, float32, float64

dtype argument checking should happen up front, earlier in the codepath of truncated_normal()
Source code / logs
See above

@slacy For reference, I am putting source code which is generating error.
snippet-1 generated via framework/tensor_util.py.
def _AssertCompatible(values, dtype):
  fn_list = _TF_TO_IS_OK.get(dtype, [_FilterNotTensor])
  mismatch = _FirstNotNone([fn(values) for fn in fn_list])
  if mismatch is not None:
    if dtype is None:
      raise TypeError("List of Tensors when single Tensor expected")
    else:
      raise TypeError("Expected %s, got %s of type '%s' instead." %
                      (dtype.name, repr(mismatch), type(mismatch).__name__))

snippet-2 and snippet-3 generated via framework/op_def_library.py
def _SatisfiesTypeConstraint(dtype, attr_def, param_name):
  if attr_def.HasField("allowed_values"):
    allowed_list = attr_def.allowed_values.list.type
    if dtype not in allowed_list:
      raise TypeError(
          "Value passed to parameter '%s' has DataType %s not in list of "
          "allowed values: %s" %
          (param_name, dtypes.as_dtype(dtype).name,
           ", ".join(dtypes.as_dtype(x).name for x in allowed_list)))

The truncated normal doesn't seem to make sense to me? The integer will be mostly zero. What do you expect as a result?

@drpngx do you have any suggestions? I tried to change flow but not passing 1 test case. Would you advise something else to make it informative?

This issue is automatically closed due to lack of activity. Please re-open if this is still an issue for you. Thanks!


Any plan for Angular 2 Server side rendering

your UI template is good, I have developed one project using core UI. but as soon I complete my project I am willing to make production ready app and for that, we need to take care of Google boat, SEO kind of things. especially for publishing your site with google console I need to do server side rendering.
so is there any solution for doing server-side rendering with core UI, angular-CLI??, Univer-CLI is not mature yet.

We have a dedicated project for Angular, so you asked in the wrong place.


[BUG] Broken plugins metrics support

libs 0.17.0 introduced the support for plugin-provided metrics in the plugin API.
However, this new feature is currently broken and should not be used.
Even if present in the plugin API (https://github.com/falcosecurity/libs/blob/master/userspace/plugin/plugin_api.h), the symbol get_metrics should not be implemented by plugins.
The issue lies in the symbol get_metrics (https://github.com/falcosecurity/libs/blob/master/userspace/plugin/plugin_api.h#L979) not being registered when the plugin is loaded.
For this reason sinsp will ignore any metric provided by plugins using this feature.

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.
If this issue is safe to close now please do so with /close.
Provide feedback via https://github.com/falcosecurity/community.
/lifecycle stale

This has already been fixed in 0.17.x


Validate units related to variables

Discussion #76 made me realize that the nomenclature.validate() function does not (yet) perform a validation whether the reported unit is in line with the nomenclature.
I recently wrote a little script for another project, it would be great if someone would volunteer to merge the unit-related part into the validate() function (and also make sure that this works for lists of allowed units, see https://github.com/openENTRANCE/nomenclature/issues/76#issuecomment-727892909).
@erikfilias @sebastianzwickl, would you have an hour to give this a try?
Note: variable_config is roughly equivalent to the nomenclature.variables dictionary.
    # validate variables and against valid template
    illegal_vars, illegal_units = [], []

    for i, (var, unit) in df.variables(include_units=True).iterrows():
        if var not in variable_config:
            illegal_vars.append(var)
        elif unit != variable_config[var]['unit']:
            illegal_units.append((var, unit, variable_config[var]['unit']))

    if illegal_vars:
        msg = 'The following variables are not defined in the project template:'
        log.error('ERROR: ' + '\n - '.join([msg] + illegal_vars) + '\n')

    if illegal_units:
        msg = 'The following units are not in line with the project template:'
        lst = [f'{v} - expected: {e}, found: {u}' for v, u, e in illegal_units]
        log.error('ERROR: ' + '\n - '.join([msg] + lst) + '\n')

thank you @danielhuppmann - I will have a look at this in the next couple of days. Gladly in coordination with @erikfilias

Thank you! Let me know if something is not clear, happy to assist!

thank you, @danielhuppmann - I will have a look at this in the next couple of days. Gladly in coordination with @erikfilias

I'm also glad to collaborate!:D

Quick update: I have started and already tested with a dummy file. The comprehensive test_functions are still missing and then I start the pull request. I will do this until Monday at the latest.


RPM should make sure that 00_htcondor_9.0.config gets moved upon installation

spec should have a line where if 00_htcondor_9.0.config is installed by the condor RPM, it gets moved.  The ONLY condor config files we should have should be the ones jobsub_lite installs.

Closed as duplicate of #19


Sweep out use of labs() from openvdb/Math.h

On Windows, labs() uses long which is int32_t instead of int64_t so we
were silently casting down in math::isUlpsEqual(). Since C++11, there
have been proper overloads of std::abs() for both long and long long
provided by <cstdlib> so just use that instead.
Signed-off-by: Edward Lam<EMAIL_ADDRESS>

Sorry folks, I just noticed that there were still some minor consistencies here so I've just pushed another commit for this.


Made env.var pythonLocation consistent for Python and PyPy

Description:
Environment variable pythonLocation was inconsistent for Python and PyPy. The behaviour of this env. variable was made consistent for both Python and PyPy and a few words about pythonLocation env. variable were added to the documentation.
Related issue:
https://github.com/actions/setup-python/issues/60
https://github.com/actions/setup-python/issues/78

This is a breaking change, some of our customers may rely on the previous behaviour

Closed in favour of this PR


Swift: Parse query where relation contains all objects from array

Currently I am trying to get an AND query instead of an OR query, but this method only works for arrays, not relations:

query.whereKey("relationKey", containsAllObjectsInArray: pfObjects)

Is there any way to do this or is it not possible yet?
Thanks, Neil

You can do it, but would need to do through a relation query.
For example:
let object = PFObject(withoutDataWithObjectId: "")
let objects: [PFObject] = []
let relation = object.relationForKey("relationKey")
let relationQuery = relation.query()
relationQuery.whereKey("objectId", containedIn: objects.map({ $0.objectId! }))

Let me know if this helps.

Unfortunately this did not work because I believe that this query fetches the actual objects of "relationKey" rather than objects that contain all of the "relationKey" objects in its relation. I am trying to fetch a list of objects that contain all of the given pfObjects in its relation. So for example I am given an array of "ClassB" objects and need to fetch all the "ClassA" objects that contain all of the given "ClassB" objects in the "ClassA" objects' relation "relationKey".

Hey @nsekhon, gotcha,
Unfortunately, $all is not supported for relation fields, though you can do containedIn aka $in operator, which will query all the objects that have your objects contained in the relation field, then you can query individual relation queries on the client and simply count the objects that you are looking for.
If that count doesn't match - then the object should be filtered.
This is the updated code snippet for your use case:
let objects = [ PFObject(withoutDataWithClassName: "ClassB", objectId: "...") ]
let query = PFQuery(className: "Class")
relationQuery.whereKey("relationKey", containedIn: objects)

Then for filtering you can do something like this
nonFilteredObjects.forEach { object in
    let query = object.relationForKey("relationKey").query()
    let count = query.countObjects
    if count == objects.count {
        filteredObjects.addObject(object)
    }
}

Let me know if this flow helps.


The model size after Lite conversion is much larger than the original Tensorflow model

1. System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Windows 10
TensorFlow installation (pip package or built from source): pip install
TensorFlow library (version, if pip package or github SHA, if built from source): 2.8.0

2. Code
import tensorflow as tf
import tensorflow_text as text
converter = tf.lite.TFLiteConverter.from_saved_model(
    saved_model_dir='chatter_engine',
    signature_keys=['serving_default']
)  # path to the SavedModel directory
print('after load')
converter.target_spec.supported_ops = [tf.lite.OpsSet.TFLITE_BUILTINS, tf.lite.OpsSet.SELECT_TF_OPS]
converter.optimizations = [tf.lite.Optimize.OPTIMIZE_FOR_SIZE]
converter.target_spec.supported_types = [tf.float16]

print('before conversion')
tflite_model = converter.convert()
print('after conversion')

# Save the model.
with open('model.tflite', 'wb') as f:
    f.write(tflite_model)
print('after write')

- Tensorflow model : https://drive.google.com/drive/folders/1WrNca1DQ9xpbH00JAVQKE8PsxFzB60qj?usp=sharing
- Tensorflow lite model: https://drive.google.com/file/d/1nqpkM3ShOTit37BHZ1A5DYEDCjaaac6J/view?usp=sharing

3. Failure after conversion
If the conversion is successful, but the generated model is wrong, then state what is wrong: the converted model size is more than 400 MB where the original model is only 4 MB

Hi @chunduriv! Could you please look at this issue? It is replicating in 2.7 ,2.8 and nightly. Size of  tflite file came 400 mb after conversion as mentioned in template.

I am also having the same issue.
I have a custom TF model that is about 16Mb
Sizes after conversion are
TF Lite Dynamic Range file size is 73.5 Mb
TF Lite Int with float fallback file size is 267.7 Mb
TF lite Full integer quantization file size is 271.2 Mb
Here is a colab that showcases the problem
TensorFlow 2.8
https://colab.research.google.com/drive/1uYZOrPJWbSGfhf-DYEgMtCVmy5xLBE5G?usp=sharing
TensorFlow 2.7.1
https://colab.research.google.com/drive/15kzXMSF2olfzNskYN99WKq7DarUy-3tj?usp=sharing
Note that integer quantization fails in 2.7.1 and for all model generated they have an incorrect input size of 1x1x1x3 but I will open a separate issue for that.

Please see my reply on similar question here

Closing please reopen if you have questions.
Thanks

@cstamatopoulos Did you manage to solve it after all? Having similar problem with model size exploding from 14M to 2GB after quantization


[Bug]: Mod won't load into the game

Operating System
Windows 10
BG3 Mod Manager Version
<IP_ADDRESS>
BG3 Game Version
v<IP_ADDRESS>22896
Bug Summary
I would put the mods I want in the active mod list and I would export it and everything, but it would never show up in the game for some reason. I know I have everything up to date, so I don't know what causing this problem
Links

[](https://imgur.com/a/uCdPt6u)
the link above is a video of what is shown when the game loads as you see in the screenshot I have my mods loaded and exported into the game, I don't know what's wrong...

I'm having the same issue, with Windows 11.  Changing the load order or removing/adding mods does not change the mod order.
I've been testing by adding, removing, and moving the SpawnAnyItem mod.
Strange thing: it was working just yesterday by switching in and out various mods.
BG3 Script Extender Debug Output
BG3Ext v18 built on Jul 23 2024 17:49:19 Game version v<IP_ADDRESS>6 OK NOTICE: Script Extender loaded without an updater present; new updates will not be fetched automatically ScriptExtender::Initialize: Starting Library startup took 1139 ms LibraryManager::PostStartupFindLibraries() took 108 ms Fossilize ERROR: Failed to parse ApplicationInfoFilter, letting recording go through. Fossilize INFO: Overriding serialization path: "H:\SteamLibrary\steamapps\shadercache\1086940\fozpipelinesv6\steamapprun_pipeline_cache". Configuration for 'Trials of Tav - a roguelike mode':         MinVersion 17; Feature flags: Lua Osiris Configuration for 'TradeWithWithers':         MinVersion 9; Feature flags: Lua Configuration for 'TradeWithWithersAddonMagicalItemsMoreRandomSelections':         MinVersion 1; Feature flags: Lua 3 mod configuration(s) loaded. Merged configuration:         MinVersion 17; Feature flags: Lua Osiris Initializing client with target context Load Modded achievements enabled. bg3se::ExtensionStateBase::LuaResetInternal(): LUA VM reset. Configuration for 'Trials of Tav - a roguelike mode':         MinVersion 17; Feature flags: Lua Osiris Configuration for 'TradeWithWithers':         MinVersion 9; Feature flags: Lua Configuration for 'TradeWithWithersAddonMagicalItemsMoreRandomSelections':         MinVersion 1; Feature flags: Lua 3 mod configuration(s) loaded. Merged configuration:         MinVersion 17; Feature flags: Lua Osiris Initializing client with target context Game bg3se::ExtensionStateBase::LuaResetInternal(): LUA VM reset. Loading bootstrap script: Mods/CombatMod/ScriptExtender/Lua/BootstrapClient.lua ecl::ScriptExtender::OnGameStateChanged(): Loaded module
Export Mod Load Order from BG3 Mod Manager
Index	Name	Author	FileName	Tags	Dependencies	URL 0	Trials of Tav - a roguelike mode	Hippo0o	CombatMod_e6f0c417-36f9-42d6-9617-fd7fe2efd626.pak			 1	TradeWithWithers	yakuzadeso	TradeWithWithers_c7c3ba79-97bd-411e-82f4-1c615e9945a7.pak	Gameplay		 2	TradeWithWithersAddonMagicalItemsMoreRandomSelections	Gigadroid	TradeWithWithersAddonMagicalItemsMoreRandomSelections_e51ebdd2-15b1-4487-8c35-4e41c2c2e6c1.pak	Gameplay		 3	SpawnAnyItem	AnteMaxx	SpawnAnyItem_2a5eb767-66a9-4101-9c7b-7d637dfca525.pak			 Override	ModFixer		Gustav_C:\Users\budok\AppData\Local\Larian Studios\Baldur's Gate 3\Mods\ModFixer.pak

This issue also accurs with me, deleted the mods, checked integrity, deleted debug profiles, no solutions.

Hey so just to update and confirm, yesterday I've helped someone to setup their ModManager and mods in Larian Discord. It was their first time to download and they also couldn't play with mods just like us. This issue happened for me after the Steam servers went down.


no PRNG

When trying to use the driver on macOS 10.12.5 in a Node.js 8.1.0 context:
/bigchaindb-driver/dist/bundle/bundle.js:7876
var randombytes = function(/* x, n */) { throw new Error('no PRNG'); };
                                         ^
Error: no PRNG

I guess just changing the entry point to bigchaindb-driver/dist/node would work around that. That entry point should always only be used in Node.js context, not relevant for browser context I think


Official documentation does not match Azure Feedback site

The Azure Feedback item here https://feedback.azure.com/forums/281804-azure-resource-manager/suggestions/38394862-automatically-delete-old-deployments-as-deployment states that DeploymentQuotaExceeded should not occur anymore as deployments get deleted automatically when a user approaches 800 per region or management group.
The quota documentation still states that deployments have to be deleted manually. For example: https://docs.microsoft.com/en-us/azure/azure-resource-manager/management/azure-subscription-service-limits#management-group-limits
I think we should consider including a link to https://docs.microsoft.com/en-us/azure/azure-resource-manager/templates/deployment-quota-exceeded and/or https://docs.microsoft.com/en-us/azure/azure-resource-manager/templates/deployment-history-deletions?tabs=azure-powershell and update the documentation accordingly (this is regarding footnote 2 in both the regional and management group section)

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 36f49a06-90b1-cbe1-3853-2c38277b79f8
Version Independent ID: 02ff6f6c-3ef6-b48f-060d-b290419e0aba
Content: Azure subscription limits and quotas - Azure Resource Manager
Content Source: articles/azure-resource-manager/management/azure-subscription-service-limits.md
Service: azure-resource-manager
Sub-service: management
GitHub Login: @davidsmatlak
Microsoft Alias: v-dasmat

@danielstocker - thanks for this feedback. The feature is not fully rolled out to Azure. I will make those changes once it goes live.

#please-close


Adding documentation and avoiding overflow operation

Fixes #{ISSUE_NUMBER}
By submitting this pull request I confirm I've read and complied with the below declarations.

[ ] I have read the Contribution guidelines and I am confident that my PR reflects them.
[ ] I have followed the coding guidelines for this project.
[ ] My code follows the skeleton code structure.
[ ] This pull request has a descriptive title. For example, Added {Algorithm/DS name} [{Language}], not Update README.md or Added new code.
[ ] This pull request will be closed if I fail to update it even once in a continuous time span of 7 days.

Hi! Thanks for showing interest in contributing to this repository.
Please make sure that you have ticked the points mentioned in PR description correctly.
Thanks again!

@gaijinco Thanks for the PR, but please create an issue first and get it assigned before sending a PR.
Also read the CONTRIBUTING.md for contributing guidelines.

@Monal5031 I created the issue https://github.com/iiitv/algos/issues/543 and it was assigned to me as far as I know.
Thanks


[BUG] Duplicates in eff_sat for initial load

Describe the bug
When I load an eff_sat with a driving key that is not the pk of that source table, I will end up with duplicates. Only happens when doing an initial load.
Environment
dbt version: 1.2.0
dbtvault version: 0.9.2
Database/Platform:  Databricks, using the snowflake macro
To Reproduce
Say I have a source model with 3 columns. PK1 and PK2 make up the PK of the model. FK is directly dependent only on PK2.

PK1
PK2
FK

123
AAA
ZZZ

123
BBB
YYY

456
AAA
ZZZ

Model a link and an eff_sat on PK2+FK
Expected behavior
In the link macro that will be used to load from PK2 & FK, a distinct happens, so AAA+ZZZ will only be loaded once. In the eff_sat macro, there are distincts as well, but not in the right place, imo. So now, AAA+ZZZ will be loaded twice. When I put a distinct in the source_data CTE on line 32, the duplicates are gone. Also, I think the other distincts (line 74, 97, 123, 144) can then be removed. (And maybe even change the unions in the records_to_insert CTE to union all?)

Thanks for this report! Just to let you know it has not gone unnoticed :)

Hi and thanks for reporting this. We've had some internal discussions and believe from the information you've provided here that it is working as intended.
A change in a PK/HK should mean a change in the record, so just because PK1 is not depended on by anything, the fact it is changing does mean something.
This is our understanding of what you have provided;
Raw/primed stage data

PK1
PK2
FK

123
AAA
ZZZ

123
BBB
YYY

456
AAA
ZZZ

Link
src_pk: [PK1, PK2]
src_fk: [FK1, FK2]
...

Eff Sat
src_pk: [PK1, PK2]
src_dfk: PK2
src_sfk: FK1, FK2
...

I would suggest that potentially, your data model might need re-thinking.
Saying this after working through the above example, I am not sure how you would be configuring your models and what the metadata would look like to achieve what you have described.
Let's continue to discuss this and see if we can get to the bottom of it

I added a payload column to the example, and specified what my dbtvault config would look like. The Attr column is dependent on the PK of the source file ([PK1, PK2]). But the source file is actually already a join between several tables from the source, so I really had to do proper analysis to see what concepts are in there, which are the keys and which are attributes, and to which key each attribute belonged. So that's how I found out that FK is dependent only on PK2, which is why I modeled [PK2, FK] as a separate link with an eff_sat on top of it. If that's completely wrong, that could be my mistake. I would have wanted to receive separate source files with the individual concepts but unfortunately, going back to the source is not an option.

PK1
PK2
FK
Attr

123
AAA
ZZZ
1A

123
BBB
YYY
1B

456
AAA
ZZZ
4A

Link1
src_pk: [PK1, PK2]
src_fk: [PK1, PK2]

Sat1
src_pk: [PK1, PK2]
src_payload: [Attr]

Link2
src_pk: [PK2, FK]
src_fk: [PK2, FK]

Eff Sat
src_pk: [PK2, FK]
src_dfk: [PK2]
src_sfk: [FK]

Hi 👋 - I've run into a very similar (if not the same) issue with regular satellites (sat macro) sourcing from a table at a different grain.
Describe the bug
Consider one source table: Projects. A project has a Client attribute. The same Client value may associate to many Projects. I have a Client satellite (and related client hub), sourced from the Projects table, with src_pk defined as the hash of the Client attribute and src_hashdiff defined as the hash of client-specific attributes. Important note: src_eff defined as the project-level modified date because there is no client-level modified date available. Satellite is materialized as incremental model with on_schema_change='append_new_columns'.
When I run the satellite model for the first time (or full-refresh), the table gets duplicate rows with the same Hash Key + Change Key values. The duplicates correlate with Project rows.
For example, if there are 2 Projects in the source table with the same Client value, the satellite gets populated with two rows with the same Client HK and same Client CK.
This goes against my expectation that only unique rows (by HK+CK) would be loaded.
Environment
dbt version: 1.5.2
dbtvault version: 0.9.2
Database/Platform: Snowflake
To Reproduce
See bug description
Expected behavior
On first run (or full-refresh) of Satellite model, the resulting table has unique HK+CK combinations as defined for that satellite.
Why I think this is happening
I dug into the compiled SQL and I think this issue comes from the way dbt's incremental materialization works.
Here is a slimmed-downed version of the compiled SQL:
WITH source_data AS (
    SELECT a.CLIENT_HK, a.CLIENT_CK, a.<client_attribute_columns>, a.EFFECTIVE_FROM, a.LOAD_DATETIME, a.SOURCE
    FROM <prime_stage_for_projects_view> AS a
    WHERE a.CLIENT_HK IS NOT NULL
),

latest_records AS (
    SELECT a.CLIENT_HK, a.CLIENT_CK, a.LOAD_DATETIME
    FROM (
        SELECT current_records.CLIENT_HK, current_records.CLIENT_CK, current_records.LOAD_DATETIME,
            RANK() OVER (
               PARTITION BY current_records.CLIENT_HK
               ORDER BY current_records.LOAD_DATETIME DESC
            ) AS rank
        FROM <sat_for_clients_table> AS current_records
            JOIN (
                SELECT DISTINCT source_data.CLIENT_HK
                FROM source_data
            ) AS source_records
                ON current_records.CLIENT_HK = source_records.CLIENT_HK
    ) AS a
    WHERE a.rank = 1
),

records_to_insert AS (
    SELECT DISTINCT stage.CLIENT_HK, stage.CLIENT_CK, stage.<client_attribute_columns>, stage.EFFECTIVE_FROM, stage.LOAD_DATETIME, stage.SOURCE
    FROM source_data AS stage
    LEFT JOIN latest_records
    ON latest_records.CLIENT_HK = stage.CLIENT_HK
        AND latest_records.CLIENT_CK = stage.CLIENT_CK
    WHERE latest_records.CLIENT_CK IS NULL
)

SELECT * FROM records_to_insert;

On first run (or full-refresh), the records_to_insert CTE results in all records from source_data (this is the prime stage view built on Projects table) because every row will meet the criteria: latest_records.CLIENT_CK IS NULL ...after all, there are no current records in the table on the first run. For a DV satellite, I would expect the records_to_insert CTE to select distinct only on  stage.CLIENT_HK and stage.CLIENT_CK.
Workarounds

(What I've implemented) Separate distinct Clients into their own table before the data vault prime stage. Avoids the problem altogether.
Add unique_key config (https://docs.getdbt.com/docs/build/incremental-models#defining-a-unique-key-optional) to the satellite model - unique key being HK and CK. However, according the dbt docs, this would result in updates to rows if the same HK+CK was loaded. This breaks DV protocol of append-only satellites.

Questions
Is there a recommended workaround for this?
Is there a custom materialization available (or in the works) for satellites which solves this scenario?
Hopefully this is enough detail to understand the issue. Thank you!

Hi! We believe this is related to the improvements we recently made to standard satellites, which was a long-standing and fundamental restriction expecting 1 instance of a key per batch.
If users don't meet these expectations then unpredictable behavior will occur.
The recent improvement we've made to standard Satellites are something we're planning to roll out to the other satellite types, including Effectity Satellites.
I cannot 100% confirm that this is the root cause, but from everything contributed here I can make a fair assumption. All of our tests for Effectity Satellites are currently passing, however they assume the standard Data Vault 2.0 loading expectations (true delta feeds, only changes).
We appreciate the ongoing discussion and information provided, we'll make sure to test the existing effectivity satellites using the provided information to reproduce the issues being encountered, and of course add regression tests for these edge cases when a fix is in place.

I've noticed the same thing on initial loads building using the effectivity sat on a stage view over the source table. It simply loads everything for the link hash key, even if the relationship hasn't changed. Our work around as been developing a dedicated raw stage model just to show distinct relationship changes over our source data and feed this to the eff macro (not ideal).
I'd have thought bringing in some of the features of the standard macro such as using a hash diff to only bring changes to the relationship and only adding new records when the hash diff changes on the driving key would be the way to go? That would remove the need to create a dedicated raw stage model just for housing data on a relationship change.


New Webhook system key enforcement breaks 3rd party binding extensions

Summary
The Authentication model for Extension WebHooks PR which was recently deployed to production breaks the WebHook scenarios for Durable Functions and other 3rd party binding extensions.  This issue primarily focuses on Durable Functions, but the fundamental issues are expected to affect others as well.
Context
Durable Functions allows clients to start a new orchestrator function instance using an authenticated HTTP call and the result is a set of URLs (including a Location header) which point to WebHook APIs implemented by the extension.  Previously these WebHook APIs were anonymously accessible, but the endpoints required the client to know the GUID of an orchestration instance in order to do anything interesting.
Repro Steps

Use VS to create a new DF application
Publish the DF application to Azure
Start a new orchestrator function instances using the HttpStart function found in the samples
Get the Location header from the response and query it

Expected: Querying the URL in the Location header returns a success response.
Actual: Querying the Location URL returns a 401 response
Details
The problem is that all Webhook endpoints now require a new extension-specific "system key" for authorization. Because the Location header doesn't include any such system key, all Webhook invocations fail with 401.
There are two issues that need a resolution:

Because the built-in WebHook URLs require auth, the Location header generated by the DF extension needs to include the system key in the query string.  However, there is no way for the extension to know what the system key is, so there is no way to generate a correct Location header.
There is currently no way to manage system keys except to make authenticated REST calls to the function app's admin endpoint. This means customers need to use cURL/Postman/etc to generate an appropriately named system key and then manually attach that to the URLs they receive from the DF extension.

Known workarounds
The known workaround is to have the customer revert back to an older version of the Azure Functions runtime and an older version of the DF extension (recent versions of the DF extension depend on unrelated features of the Functions runtime which were deployed at the same time).
The other workaround is to do all the manual steps mentioned earlier to provision a system key and attach it to all web hook URLs received from the extension.

The runtime does auto-provisioning of extension hook keys if not present, and makes them available to the extension via the GetURL method of the extension hook provider: https://github.com/Azure/azure-webjobs-sdk-script/blob/8309e2b58008d8abed55d419f3e7e23d771f7ede/src/WebJobs.Script.WebHost/WebHooks/WebJobsSdkExtensionHookProvider.cs#L36
So you should be able to get this URL in your extension, grab the code value and use it

@cgillum - are you unblocked now? can this be closed?

Yep. Verified that the auto-provisioning works. I will release an update of the DF extension which leverages this behavior.


Tests and builds

Following @aristath comment on #806. I totally agree on the necessity and enforcement of coding standards. Being a 100% WordPress related project it only makes sense to follow WordPress standards.
To make it easier and faster for everyone I suggest (from what I've seen on other projects):

Adding tests both on local grunt and on the Travis built to validate the syntax. If I open a PR with code that doesn't follow the standards I'll receive an email notification with the syntax errors and the build "fail".
Removing compacted and minified files from Github, have Grunt and Travis build them, it will make it easier to navigate the source code, will make branching/forking/etc...faster. And it is generally  considered as good practice.

What do you think?

---
Want to back this issue? **[Post a bounty on it!](https://www.bountysource.com/issues/32613687-tests-and-builds?utm_campaign=plugin&utm_content=tracker%2F2030945&utm_medium=issues&utm_source=github)** We accept bounties via [Bountysource](https://www.bountysource.com/?utm_campaign=plugin&utm_content=tracker%2F2030945&utm_medium=issues&utm_source=github).

grunting & merging has become a nightmare.
I agree, we need to do something like what you described above.
However, this is what I was considering:
I was thing of completely deleting the customizer.js & customizer.min.js files.
Instead, perhaps it would be best to just load the appopriate files by directly enqueuing them from the controls.
So if the user doesn't have a repeater for example, they simply won't get the repeater scripts loaded.
Pros: easier dev, no more grunting things that don't really need to be grunt'd, better debugging since if there are any issues we'll know exactly what happens at which file etc
Cons: when the customizer loads it will load more files and this is the reason why I initially decided to grunt all JS. However, since the customizer is not exactly frontend and we don't have to worry about google pagespeed and stuff like that, the delay will be what, a couple miliseconds maximum? I'm not sure that combining JS assets in the context that Kirki uses them is worth it.
Thoughts?

There is 2 things here:
**1) I think we need to keep grunt/travis/etc... for SASS>CSS, tests, lint, code style enforcement etc. **
jscs is a great grunt/ Javascript CS enforcer.
This article has some good suggestions
2) I agree that the JS concat and min in not necessary. Especially since HTTP/2 is recommending to move away from concats.
However, Kirki is probably going to keep growing, more controls and probably bigger controls too. I think it would be great to approach each controller as an independent "plugin" or "package" and allow devs to enable/disable them. This way devs could enable only enable the controls they need and therefor limiting the number of JS/CSS files included.

I think we need to keep grunt/travis/etc... for SASS>CSS, tests, lint, code style enforcement etc.

Agreed.

I think it would be great to approach each controller as an independent "plugin" or "package" and allow devs to enable/disable them. This way devs could enable only enable the controls they need and therefor limiting the number of JS/CSS files included.

Definitely the way to go.
I guess separating the JS files is just going to be the first step in that direction :+1:

Scripts are now non-concatenated.
I like the idea of using JSCS in travis as well as a similar one for PHP coding-standards... I'll investigate and hopefulyy get this done in the next couple of days.

Great! A lot of people work on multiple projects with different coding standards, it's hard to keep track of all of them. Having an automated way to enforce them is the best way to go!

I was looking for this for another project, thought I would share it here: https://docs.travis-ci.com/user/deployment/releases/
We should remove .css files from github, .gitignore them and upload them using the above method to releases.
It would require devs to do an initial npm update and grunt before starting to work but would prevent having to commit min files each time you do a css update.

Also it would be great if the POT file was not updated each time you do a grunt. Maybe have a special job for updating POT like ie: grunt language

I managed to get js & php coding standard checks in travis.
For the time being I just deactivated them though 'cause fixing all the reported issue at once was too much to handle.
I'll be slowly enabling more checks and fixing issues one by one.
Otherwise I'd have to just dedicate 3 days to that without doing anything else.

We should remove .css files from github, .gitignore them and upload them using the above method to releases.

I'd be willing to remove the .css.min files from github, as well as any .map files. After all, these are the ones that cause most merge conflicts.
But I wouldn't want to remove the .css files...
Not everyone knows what grunt is or how to use it.
As for the language file I agree completely. I'll do that now :+1:

Took me a few days but I finally managed to resolve ALL codesniffer issues, both JS & PHP.
Closing this one, but if you have any more suggestions I'm all ears. :+1:

@aristath one last request :-)
I think it would be amazing to add either to the default or a specific 'dev' grunt task : watch,sass,phpcs,jscs. This would be amazing to get live feedback and sass compile on the fly while working.
https://www.npmjs.com/package/grunt-jscs
https://www.npmjs.com/package/grunt-phpcs

reopening :)
grunt-jscs looks good to me and it also accepts the .jscsrc we have.
grunt-phpcs however will be a little more complicated 'cause we'll also have to install the WordPress Coding standards from https://github.com/WordPress-Coding-Standards/WordPress-Coding-Standards
I'll definitely add the 1st one, I'll try to find the least painful way for the 2nd one. :+1:
In the meantime If you have any ideas and want to submit a PR of course I'd be more than happy to merge it!


Add cegcc

Requested by the lovely people at NNG: https://github.com/MaxKellermann/gcc

https://github.com/MaxKellermann/cegcc-build is nmeeded to get a cross-compiling toolchain going.


opam monorepo 0.1.0 support

This contains preliminary support for opam-monorepo 0.1.0 (not out yet).
Some remarks and open questions:

[ ] should we install opam-monorepo through opam-tools or in its own switch to that it's coinstallable with anything?
[x] should we use a persistent _build directory?
[ ] should we add lint builds?
[x] depext handling is a bit ad-hoc. pinning the lock file fails because there does not seem to be a solution. it would be nice if depexts could be added to the lockfile.
[ ] there is not a lot of sharing with the duniverse support; once it goes away it would be nice if adding an opam-monorepo version is easier
[ ] (related) the new code is a bit all over the place. it would be nice if it could be in one module (or one module for types and one module for the rest at least)
[ ] we could add a couple extra tests, e.g. no dune-project file, no opam file.
[ ] format (local ocamlformat for new files, ocp-indent + tweaks for the rest)

cc @NathanReb

Thanks for the PR!  Some quick comments:

if opam-monorepo is a plugin, then its installation is a bit special. opam builds the plugin in the current switch but installs the binary globally (into ~/.opam/plugins/bin) so its available to all future switches.  So you could prod opam-tools into installing opam-monorepo globally using one of its tools switches, to avoid contaminating the local project's dependencies.

what's the upstream opam monorepo support for handling depexts?  With the duniverse binary, it tracked depexts in the dune-get file.  We do need something equivalent with the opam files -- why aren't the depexts from the opam files just propagated?

one the above are answered, a persistent build directory is indeed necessary. The existing duniverse uses a shared _build dir and gets very nice incremental build speeds as a result.

Regarding persisting _build, in the past there has been a case in RWO where we had to run dune clean locally for the fix to kick in. I could see that happen again (rarely) in the future.

is there a way to manually clear this cache?
does this cache have an expiration time?
should we clear this cache when the lock file changes (for example, by adding a hash of the lock file to the cache key)?

Each builder in the cluster has its own copy of the cache, and changes are not always saved (e.g. if two builds use the cache concurrently, only one of them will save its copy at the end). Also, the cache is shared between branches, so updating it to a new format on one branch might require downgrading it again on the other one.
Including the dune version in the cache ID might be a good idea (in case one branch tries to upgrade the cache format and another one doesn't want that), but apart from that I think it's dune's responsibility to ensure the cache is correct.
Caches don't expire at the moment, but we could add that easily enough.

what's the upstream opam monorepo support for handling depexts? With the duniverse binary, it tracked depexts in the dune-get file. We do need something equivalent with the opam files -- why aren't the depexts from the opam files just propagated?

My intuition was that opam depext should be able to handle it from the lockfile. If it's not then I can include all the transitive depexts in the lockfile but in the long run I think it'd be better if opam depext can do the right thing. @emillon what exactly is the issue with opam depext? It can't take an opam file as an input so you have to pin the package and that fails for what reason?

I thought that failed, but I tried again and it works. Maybe this was done at the wrong step. In any case, that part works now.

Update for the depext situation: actually, it's not working. opam pin -n --locked add . interprets add as the lockfile suffix, and falls back to using the normal opam file (with a warning). When passing --locked last, it pins recursively. At the moment this fails in cases where virtual packages are used (e.g. uchar). We're looking at a possible solution for that.

To clarify virtual packages are okay but not for packages+versions that aren't on the main opam-repository!

The depext situation is now fixed. We need to recursively pin for now but recursive depexts will be added in a future version of opam-monorepo. I also added _build directory caching (the same that was used in duniverse).
I had a look at installing opam-monorepo through opam-tools, but this means building a compiler fairly late in the build process (after the opam file is available). In contrast, the current solution selects a base image based on the version in the lock file. This guarantees that no compiler is built, but this only works if the CI has the right image. The other drawback of the current solution is that the dependencies of opam-monorepo are present in the current switch, but this is a monorepo build so no other packages are going to be installed.
I'll have another look to see if it's possible to do the build a bit earlier (and somehow cache the various tool switches?) but otherwise these two limitations might be ok for a first version. What do you think?

The other drawback of the current solution is that the dependencies of opam-monorepo are present in the current switch, but this is a monorepo build so no other packages are going to be installed.

This is true now because we use a pinned version but the released one won't have any deps but dune and ocaml, rest will be vendored in the tarball so we can consider this one fixed. For the next release we'll also make sure we have a way to tell opam and opam-monorepo which dependencies have to come via opam and which ones need to be vendored. When we reach this point, the dependencies in the opam file will be properly interpreted, be it a released or a pinned version.

And this is now ready to go.
In terms of release plan, @NathanReb and I were thinking that we:

merge this
make sure that realworldocaml/book#3412 is green (it is with ocaml-ci-local but who knows)
release the plugin on opam
update the plugin installation so that it is done from the opam release

And as next steps for support itself:

add lint builds
install the plugin in a separate switch by hand or using opam-tools

Thanks! the realworldocaml built went fine, so I think we can release the plugin. I'll update this PR once it's done.

Can this be merged now? It makes it more difficult to deploy other features if they have to be temporarily merged with this unmerged branch first.

Yes, that can be merged. I just pushed a quick fix so that it's usable in opam-monorepo itself. I'll do the rest of the work (update to use 0.1.0 from opam) in a separate PR. Thanks!

Thanks!


KML icons enhancement

Work is on in kml_icon branch.

[x] Icon hotSpot xunits and yunits can be different
[ ] Handle icons scale
[ ] Fix default icons position and scale

Links for refs :
https://github.com/openlayers/ol3/commit/65fe82d1889c508679cf88f140b6f0071e209c5d

leaflet KML ignores xunits and yunits if they defined in pixels. Please look at the simple example below
http://katrine.lpi.ru/kalenkov/leaflet/hotspot-kml.html
http://katrine.lpi.ru/kalenkov/leaflet/hotspot.kml
I expect that the placemark icons should be shifted by 100 pixels in x and 100 pixels in y directions, But instead they completely overlap.

@kalenkov could you test with the https://github.com/shramov/leaflet-plugins/tree/kml_icon please ?

yes, kml_icon branch works fine
http://katrine.lpi.ru/kalenkov/leaflet/hotspot-kml_icon.html

Great, thx for the feedback, just have to wait this branch merge.


Merge branch 'master' of https://github.com/JDJGInc/JDBot

When it's done tell me, so I know when to merge
I will make a commit to fix the black issue then pull vps side.


Aberrant-FR

Translation of Aberrant character file in French.
Changes / Comments
It's a copy of the current Aberrant character file but translated in French.
Roll20 Requests
Comments are very helpful for reviewing the code changes. Please answer the relevant questions below in your comment.

[ ] Does the pull request title have the sheet name(s)? Include each sheet name.
[ ] Is this a bug fix?
[ ] Does this add functional enhancements (new features or extending existing features) ?
[ ] Does this add or change functional aesthetics (such as layout or color scheme) ?
[ ] If changing or removing attributes, what steps have you taken, if any, to preserve player data ?
[ ] If this is a new sheet, did you follow Building Character Sheets standards ?

If you do not know English. Please leave a comment in your native language.

From the Readme's Internationalization & Translations-section:

Sheets that are duplicated and translated manually rather than using this translation process will not be accept.

Hi @Faustjohan in the future it would be better to utilize Crowdin in the sheet translations. I look forward to that update!

Greetings,
As others have noted we no longer accept duplicate character sheets purely for translation. The recommended practice for updating a character sheet translation is to add data-i18n elements to the original, https://roll20.zendesk.com/hc/en-us/articles/360037773493-Character-Sheet-Translation
Thank you,
Cassie


Enable warnings during D compilation and fix all warnings

I have tried to fix all warnings in the way that seemed most "correct" to me.
See forum discussion here<EMAIL_ADDRESS>tested wih dmd 2.069.0 and 2.070.0

While working on this, I stumbled on what appears to be a bug: https://issues.dlang.org/show_bug.cgi?id=15731

@yebblies Fixed -wi, squashed and rebased on master, looked green on all testers.


Pixiv Download Stop

When downloading an illustration photo as a tag, there is an empty part at the end of each schedule page.
When this empty part is met, the next page remains, but the download stops.

Example id?

[image: image.png]
There are more pages behind, but in this situation, the download stops as
it is.
2023년 6월 29일 (목) 오전 9:07, biggestsonicfan @.***>님이 작성:

Example id?
—
Reply to this email directly, view it on GitHub
https://github.com/Nandaka/PixivUtil2/issues/1278#issuecomment-1612257778,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/BA5DSSL5YVI4STUJJY2YUB3XNTBKLANCNFSM6AAAAAAZXKK4AU
.
You are receiving this because you modified the open/close state.Message
ID: @.***>


9/28/2021 Publish

Docs Build status updates of commit 402b6e8:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

azureadps-2.0/AzureAD/Set-AzureADUser.md
:white_check_mark:Succeeded
View (azureadps-2.0)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching the docs.microsoft.com contributor guidesPost your question in the Docs support channel


Update to 10.8.4-1

Hi there, could you please update the image to the latest version 10.8.4-1?

Closed in #14 and released in #12


Cache data from_meta error, data type doesn't match

Hi, I faced with one error in caching data functions in the latest version
Traceback (most recent call last):
  File "/redacted/Karuha/karuha/event/base.py", line 17, in handler_runner
    ret = super(Event, event).call_handler(func)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/redacted/Karuha/karuha/utils/invoker.py", line 123, in call_handler
    return handler(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/redacted/Karuha/karuha/data/cache.py", line 356, in handle_meta
    cache_me_subscription(user, sub_meta)
  File "/redacted/Karuha/karuha/data/cache.py", line 316, in cache_me_subscription
    sub = Subscription.from_meta(sub_meta)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/redacted/Karuha/karuha/data/meta.py", line 226, in from_meta
    return cls(
           ^^^^
  File "/redacted/.local/lib/python3.11/site-packages/pydantic/main.py", line 193, in __init__
    self.__pydantic_validator__.validate_python(data, self_instance=self)
pydantic_core._pydantic_core.ValidationError: 1 validation error for Subscription
  Input should be a valid dictionary [type=dict_type, input_value=b'{"comment":""}', input_type=bytes]

In karuha/data/meta.py line 228, we can solve it by changing
private=meta.private or None

to
private= json.loads(meta.private) if meta.private else None,

The other dict fields should also be changed.

This is indeed a bug. I declared the type of the public and trusted fields as Json, but forgot to change the type of the private field. I will submit a commit to fix this.

Now you can try the code on the dev branch to see if that solves the problem.

It works well now. Thanks for your immediate reply!


Success HUD now small?

I've noticed in a recent update (alas I don't know which version exactly) the success HUD is now quite a bit smaller, basically just the size of the checkmark. Is this expected behavior, or is this a bug?

The HUD size previously was fixed (100x100 min) and now is dynamic based on the content. I could adjust the "spacers" left and right from the image, however I think it works out fine.

Try this HUD library for iOS in swift https://github.com/shubh10/JustHUD

By the way you could still change the minimum size and ring radius.


Update FAQ.md: desugar ~> eta-expand

Some good points are being made here about code readability. Thank you. I propose a small correction that will hopefully

stop the "experts" from jumping at your throat (because what is described here is not "desugaring" in the technical PL sense)
convince others even more of your point, because "eta-expansion" sounds more scary than "desugaring" :)

Thanks @buggymcbugfix, it's nice to have things correct :) . I've added a minimal example so we make sure that the reader understands what eta-expansion is.


Problem with variance estimator

Hello Professor Chopin,
Thanks for the excellent package and your hard work! Your write up of the package and ease of modification is incredible.
I ran into a bug when I was trying to employ the variance estimator, namely when calling
from particles import variance_estimators as var
fk = ssms.Bootstrap(ssm=LinStSp(lambda_i=monte_lambda, S=monte_S, ini_fac=monte_f0), data=y_monte)
pf = particles.SMC(fk=fk, N=R, qmc=False, store_history=True, resampling='systematic', collect=[particles.collectors.Moments(), var.Var()])
pf.run()
paths = pf.hist.backward_sampling_mcmc(M=R)

It appears that Var() creates a typing error. I tried with or without storing history and partial history and without the second collector but the following error persists:
Input [In [61]](vscode-notebook-cell:?execution_count=61), in <cell line: 4>()
      [2](vscode-notebook-cell:?execution_count=61&line=2) fk = ssms.Bootstrap(ssm=LinStSp(lambda_i=monte_lambda, S=monte_S, ini_fac=monte_f0), data=y_monte)
      [3](vscode-notebook-cell:?execution_count=61&line=3) pf = particles.SMC(fk=fk, N=R, qmc=False, store_history=True, resampling='systematic', collect=[particles.collectors.Moments(), var.Var()])
----> [4](vscode-notebook-cell:?execution_count=61&line=4) pf.run()
      [5](vscode-notebook-cell:?execution_count=61&line=5) # paths = pf.hist.X
      [6](vscode-notebook-cell:?execution_count=61&line=6) paths = pf.hist.backward_sampling_mcmc(M=R)

File ~/.local/lib/python3.9/site-packages/particles/utils.py:85, in timer.<locals>.timed_method(self, **kwargs)
     [82](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/utils.py:82) @functools.wraps(method)
     [83](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/utils.py:83) def timed_method(self, **kwargs):
     [84](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/utils.py:84)     starting_time = time.perf_counter()
---> [85](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/utils.py:85)     out = method(self, **kwargs)
     [86](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/utils.py:86)     self.cpu_time = time.perf_counter() - starting_time
     [87](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/utils.py:87)     return out

File ~/.local/lib/python3.9/site-packages/particles/core.py:422, in SMC.run(self)
    [405](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:405) @utils.timer
    [406](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:406) def run(self):
    [407](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:407)     """Runs particle filter until completion.
    [408](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:408)
    [409](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:409)     Note: this class implements the iterator protocol. This makes it
   (...)
    [420](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:420)     command only.
    [421](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:421)     """
--> [422](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:422)     for _ in self:
    [423](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:423)         pass

File ~/.local/lib/python3.9/site-packages/particles/core.py:396, in SMC.__next__(self)
    [394](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:394)         self.resample_move()
    [395](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:395) self.reweight_particles()
--> [396](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:396) self.compute_summaries()
    [397](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:397) self.t += 1

File ~/.local/lib/python3.9/site-packages/particles/core.py:381, in SMC.compute_summaries(self)
    [378](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:378) # must collect summaries *after* history, because a collector (e.g.
    [379](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:379) # FixedLagSmoother) may needs to access history
    [380](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:380) if self.summaries:
--> [381](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/core.py:381)     self.summaries.collect(self)

File ~/.local/lib/python3.9/site-packages/particles/collectors.py:231, in Summaries.collect(self, smc)
    [229](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/collectors.py:229) def collect(self, smc):
    [230](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/collectors.py:230)     for col in self._collectors:
--> [231](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/collectors.py:231)         col.collect(smc)

File ~/.local/lib/python3.9/site-packages/particles/collectors.py:271, in Collector.collect(self, smc)
    [270](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/collectors.py:270) def collect(self, smc):
--> [271](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/collectors.py:271)     self.summary.append(self.fetch(smc))

File ~/.local/lib/python3.9/site-packages/particles/variance_estimators.py:169, in Var.fetch(self, smc)
    [167](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/variance_estimators.py:167) def fetch(self, smc):
    [168](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/variance_estimators.py:168)     self.update_B(smc)
--> [169](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/variance_estimators.py:169)     return var_estimate(smc.W, self.test_func(smc.X), self.B)

File ~/.local/lib/python3.9/site-packages/particles/variance_estimators.py:129, in var_estimate(W, phi_x, B)
    [127](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/variance_estimators.py:127)     out = np.zeros_like(m)
    [128](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/variance_estimators.py:128) else:
--> [129](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/variance_estimators.py:129)     out = _sum_over_branches(w_phi, B)
    [130](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/particles/variance_estimators.py:130) return out

File ~/.local/lib/python3.9/site-packages/numba/core/dispatcher.py:468, in _DispatcherBase._compile_for_args(self, *args, **kws)
    [464](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/numba/core/dispatcher.py:464)         msg = (f"{str(e).rstrip()} \n\nThis error may have been caused "
    [465](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/numba/core/dispatcher.py:465)                f"by the following argument(s):\n{args_str}\n")
    [466](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/numba/core/dispatcher.py:466)         e.patch_message(msg)
--> [468](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/numba/core/dispatcher.py:468)     error_rewrite(e, 'typing')
    [469](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/numba/core/dispatcher.py:469) except errors.UnsupportedError as e:
    [470](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/numba/core/dispatcher.py:470)     # Something unsupported is present in the user code, add help info
    [471](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/numba/core/dispatcher.py:471)     error_rewrite(e, 'unsupported_error')

File ~/.local/lib/python3.9/site-packages/numba/core/dispatcher.py:409, in _DispatcherBase._compile_for_args.<locals>.error_rewrite(e, issue_type)
    [407](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/numba/core/dispatcher.py:407)     raise e
    [408](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/numba/core/dispatcher.py:408) else:
--> [409](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/.local/lib/python3.9/site-packages/numba/core/dispatcher.py:409)     raise e.with_traceback(None)

TypingError: Failed in nopython mode pipeline (step: nopython frontend)
No implementation of function Function(<built-in function iadd>) found for signature:

 >>> iadd(float64, array(float64, 1d, C))

There are 18 candidate implementations:
  - Of which 16 did not match due to:
  Overload of function 'iadd': File: <numerous>: Line N/A.
    With argument(s): '(float64, array(float64, 1d, C))':
   No match.
  - Of which 2 did not match due to:
  Operator Overload in function 'iadd': File: unknown: Line unknown.
    With argument(s): '(float64, array(float64, 1d, C))':
   No match for registered cases:
    * (int64, int64) -> int64
    * (int64, uint64) -> int64
    * (uint64, int64) -> int64
    * (uint64, uint64) -> uint64
    * (float32, float32) -> float32
    * (float64, float64) -> float64
    * (complex64, complex64) -> complex64
    * (complex128, complex128) -> complex128

During: typing of intrinsic-call at /Users/Adrian/.local/lib/python3.9/site-packages/particles/variance_estimators.py (138)

File "../../../../.local/lib/python3.9/site-packages/particles/variance_estimators.py", line 138:
def _sum_over_branches(w_phi, B):
    <source elided>
    for m in range(N):
        s[B[m]] += w_phi[m]
        ^

I'm on an M2 Mac with the new arm64 architecture and use Python 3.9 on VS Code, not sure if it's a software issue on my end?
Thank you!
Adrian

Weird... Please upload a MWE (minimal working example), so that I can try to see what is going on my end. (The first box is not a MWE, I don't know how you defined LinStSp). If you can make it as small as possible, that'd be great.

Ah yes apologies, here the parameters and the model, essentially a multivariate linear Gaussian model with transform matrix lambda, VAR lag S and some parameter restrictions.
import numpy as np
import particles
from particles import distributions as dists
from particles import state_space_models as ssms
Q=2 # dimension latent variable
N=100 # dimension series
R=1000 # number particles
T = 50 # time periods
def generate_S(Q):
if Q > 1:
s = np.random.uniform(-0.9, 0.9, size=Q)
s = np.array(s / np.sum(np.abs(s)), ndmin=2)
S = s.T @ s
return S
else:
return np.array(np.random.uniform(-0.8, 0.8), ndmin=2)
monte_S = generate_S(Q)
def construct_lambda(N, Q):
# constructs a coefficient matrix satisfying the identification restrictions
eigenvalues = np.random.uniform(low=2.0, high=10.0, size=Q)  # distinct, non-zero eigenvalues
Lambda = np.diag(eigenvalues)
U, _ = np.linalg.qr(np.random.normal(size=(N, Q)))
A = U @ np.sqrt(Lambda)
return A
monte_lambda = construct_lambda(N, Q)
monte_f0 = np.zeros((Q,1)) # initial value
class LinStSp(ssms.StateSpaceModel):
default_params = {'lambda_i': np.random.normal(size=(N,Q)), 'S': np.eye(Q), 'ini_fac': np.zeros(Q)}
def PX0(self):
    return dists.MvNormal(loc = self.ini_fac.T , cov=np.eye(Q))

def PX(self, t, xp):
    mean = self.S @ xp.T # will be Q x R
    return dists.MvNormal(loc = mean.T, cov=np.eye(Q)) # and transpose then R x Q

def PY(self, t, xp, x):
    meanY = self.lambda_i @ x.T # + self.beta # will be N x R
    return dists.MvNormal(loc = meanY.T, cov=np.eye(N))

simulate data
model_fil = LinStSp(lambda_i = monte_lambda, S= monte_S, ini_fac = monte_f0)
x_monte, y_monte = model_fil.simulate(T+200)
x_monte, y_monte = x_monte[200:], y_monte[200:]
from particles import variance_estimators as var
fk = ssms.Bootstrap(ssm=LinStSp(lambda_i=monte_lambda, S=monte_S, ini_fac=monte_f0), data=y_monte)
pf = particles.SMC(fk=fk, N=R, qmc=False, store_history=True, resampling='systematic', collect=[particles.collectors.Moments(), var.Var()])
pf.run()
paths = pf.hist.X
paths = pf.hist.backward_sampling_mcmc(M=R)

The scary message from Numba was actually hiding a simple bug, which triggered an error only when function $\varphi$ is such that $\varphi(x)$ is a vector (instead of a scalar); in your case $\varphi(x)=x$ (default function), and your $x$ is of vector of dimension 2.
It's now fixed in the experimental branch. I'll run more tests when I'm back from holiday, before pushing the fix to the master branch. Please switch to experimental in the meantime. And thanks a lot for spotting this and reporting it here.

Ah that's what it was I already suspected the Numba in my virtual env. Thanks so much for looking into this so quickly, appreciate it.

As a follow up, now it appears that something is amiss in the newest experimental branch:
from particles import state_space_models as ssms

results in
AttributeError                            Traceback (most recent call last)
Input [In [6]](vscode-notebook-cell:?execution_count=6), in <cell line: 30>()
     [28](vscode-notebook-cell:?execution_count=6&line=28) import particles
     [29](vscode-notebook-cell:?execution_count=6&line=29) from particles import distributions as dists
---> [30](vscode-notebook-cell:?execution_count=6&line=30) from particles import state_space_models as ssms
     [31](vscode-notebook-cell:?execution_count=6&line=31) from particles import kalman
     [33](vscode-notebook-cell:?execution_count=6&line=33) import tracemalloc

File ~/Documents/Research/SMC Theory/particles/particles/state_space_models.py:301, in <module>
    [295](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/Documents/Research/SMC%20Theory/particles/particles/state_space_models.py:295)         y = self.simulate_given_x(x)
    [296](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/Documents/Research/SMC%20Theory/particles/particles/state_space_models.py:296)         return x, y
--> [301](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/Documents/Research/SMC%20Theory/particles/particles/state_space_models.py:301) class Bootstrap(particles.FeynmanKac):
    [302](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/Documents/Research/SMC%20Theory/particles/particles/state_space_models.py:302)     """Bootstrap Feynman-Kac formalism of a given state-space model.
    [303](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/Documents/Research/SMC%20Theory/particles/particles/state_space_models.py:303)
    [304](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/Documents/Research/SMC%20Theory/particles/particles/state_space_models.py:304)     Parameters
   (...)
    [316](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/Documents/Research/SMC%20Theory/particles/particles/state_space_models.py:316)         considered state-space model
    [317](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/Documents/Research/SMC%20Theory/particles/particles/state_space_models.py:317)     """
    [319](https://file+.vscode-resource.vscode-cdn.net/Users/Adrian/Documents/Research/Latent%20State%20Models/SMC_implement/~/Documents/Research/SMC%20Theory/particles/particles/state_space_models.py:319)     def __init__(self, ssm=None, data=None):

AttributeError: module 'particles' has no attribute 'FeynmanKac'


Fix calc.inf, -calc.inf, and calc.nan reprs and displays

Fixes #2955.
I decided to use calc.inf and calc.nan instead of float("inf") and float("nan") because the former feel like constants, while the latter feel like more arbitrary ways of getting the values. Ideally, I think float.inf and float.nan would be better (see side note below).

Value
Repr
Display / str

calc.inf
"calc.inf"
∞

-calc.inf
"-calc.inf"
−∞

calc.nan
"calc.nan"
NaN

calc.inf * 1pt
"calc.inf * 1pt"

-calc.inf * 1pt
"-calc.inf * 1pt"

I also added some unrelated float-related tests in the last commit.
As a side note, I'm wondering whether we should move calc.inf and calc.nan to float.inf and float.nan as they seem more related to the IEEE-754 format than to calculations.

Thanks!

As a side note, I'm wondering whether we should move calc.inf and calc.nan to float.inf and float.nan as they seem more related to the IEEE-754 format than to calculations.

That makes sense. calc.nan does not seem to be used in Typst Universe. calc.inf is used in three packages. So the breakage is rather minimal. But we could still duplicate them & deprecate the old ones for now. (No infrastructure for deprecating consts though atm.)


Unable to install pyodbc on Windows 10 using Bash for windows

Python: 2.7
pyodbc: 4.0.17
OS: 64bit windows
DB: MSSQL
driver:Microsoft ODBC Driver 13 for Linux

Issue
I am trying to install pyodbc and receive the falling error on install:

I have also attempted to install with windows odbc drivers as well. No luck

src/pyodbc.h:45:20: fatal error: Python.h: No such file or directory

The pyodbc build procedure cannot find the Python header files. If you are trying to install pyodbc for Python27 you need to
sudo apt install python-dev


Support .js imports from typescript

This resolves https://github.com/zeit/ncc/issues/508 in allowing the pattern for TypeScript code using .js extensions to reference other TypeScript files.
This is currently recommended by the TypeScript team (https://github.com/microsoft/TypeScript/issues/16577#issuecomment-309169829) as an approach for writing TypeScript that will include the file extensions in the output files when using tsc manually, resulting in Node.js and browser compatibility for the output.
With this PR, ncc doesn't have to break enabling this workflow for users, while remaining backwards compatible with the previous behaviour so it would be fine to release this as a minor.

@guybedford Do we also need too add this behavior to node-file-trace?

@styfle thanks for the quick review. Yes ideally node-file-trace would include the same (if it doesn't support it already), and this is something I'd recommend checking in other workflows too.

Ok, I've included a guard that this extension fallback only happens when importing from another TypeScript file, and I also added a test here for nested imports of .ts.